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ABSTBACT " ■ x 

' " This report examines the state of the art ox 
utilizing cost-benefit "Methodologies to evaluate tae xetuxns on 
investments in vocational education*. The objectives ana toxm^t of the 
report and the literature search methodology employed in it axe * 
outlined. Presented next is an over vie fc of the diverse literature 
related to cost-benefit analysis, including^ discussions ox litex;ature 
relating to the economics of education, cost-benexit and educational 
evaluation theories, cost-benefit applications in vocational 
education, an<3 vocational education data sources* A tptai of 32 
abstracts of some of the major literature in each of these areas is 
provided. Included in the final section of the report axe 
bibliographies of works in each of the areas. (Bexated xepoxts on 
other components of the project and the final project xepoxt are j 
available separately through EBIC — see note.). (Mfl) 
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SECTION 1 

i 

' INTRODUCTION t . 

* 

Cost-benefit analysis is one important method for improving resource allo- 
cation 'in the .general area of sociaT welfare. The Bepartme^nt of Education has 
contracted v wi th Reh.ab Group, [Inc. for. a study assessing the feasibility of per- 
forming .a national cost-benefit analysis of secondary, postsecondary* and adult 
vocational education. The 'components of this study include: 



• An analysis of tftelniFasurement problems in performing a natiopal 
cost-benefit study. ^ - ' 

• An 'assessment of the state of the art in applying cost-benefit 
methodologies to vocational education. t * 

• Recommendations concerning the feasibility of performing a national 

cost-benefit study. . 

* *• 

* 

Each of these study components is examined in a separate document. The 
reports are written as companion pieces utilizing similar format and terminology.' 
In addition, a final report synthesizes the primary findings jDf all study areas 
into- one document. 4 . * « 

STATE OF THE ART REPORT OBJECTIVES 

V ■ 

This report surveys the stats of 1 the art of utilizing cost-benefit methodolo- 
gies to evaluate the returns oji investment in vocational education. The primary 
objective of the paper is to identify and summarize exis-ting cost-benefjt Studies 
of vocational education and the literature describing the theory and methodology 
of cost-benefit analysis. The identification and summarization process will 
i Tl un^i hi ate the strengths and weaknesses of existing cost-benefit designs. This 
'information will play a primary role in accomplishing the remaining two objectives 
of this study: to identify the major problems in measuring vocational education ^ 
costs and benefits and to determine the feasibility of performing a national- cost- 
benefit analysis. ' v - . 

IT 

No systematic critical discussion of the strengths and weaknesses of the 
various cost-benefit designs reviewed ifi this report is- undertaken at ttfis 
time. This is accomplished in a separate document, Design of a National 



\ 



V 



Cost-Benefit Study- of Vocational Education at the Secondary, Posts.econdary and 
Adult Levels: Cost-Benefit Measurement Report . Similarly, nc extensive con- 
clusions are drawn in* this paper on the utility of using any existing designs 
in a national. cost-benefit study. These conclusions appear in Design of a 
National, Cost-Benefit Study of Vocational Education at the Secondary, Post- 
secondary, and Adult Levels: Cost-Benefit Feasibility Report . 

--Therefore,- the-state-of- the~art revieV of cost-benefit applications to 
vocational education serves . two principal purposes. First, the results of 
the overview are summarized to provide a general understanding of the literature 
relevant to cost-benefit analysis of vocational education. Second, the overview 
.procedur^and results serve as part of the methodology to accomplish the re- 
maining objectives of the project and form a basis for the other components 
of this study. 

STATE OF THE ART REPORT FORMAT 

The results of the literature review process are reported' in four ways. 
First, an overview o.f the literature is presented. The overview summarizes 
the methodologies and findings of major, literature on the theory and appli- 
cation -of cost-benefit analysis. Second, selected outstanding pieces of 
literature are abstracted. The abstracts provide the reader with more in- . 
depth information on some of the most influential literature in the field than 
can be provided- in the overview. Third, 'a comprehensive bibliography of books, 
articles, monographs, reports, and unpublished dissertations and p'apers is 
furnished. Fourth, a glossary of terms used in the analysis of vocational 
• education costs and benefits is included. 

* 

The body of literature relevant to evaluating the costs and benefits of 
vocational education is sizable and multidisciplinary. In order to make the 
presentation of findings more Itianageab'le, four areas of concentration were 
established. „Each deals with theories and issues relBvantto performing a' 
national cost-benefit analysis of vocational education. These areas are: _ 
literature on the economics and financ^g^cbst^ of vocational " - 
education . ' %t „ 

Literature on the methodology of cost-benefit analysis. . 
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• Existing cost-benefit studies of vocational education. t . 

• Literature gn vocational -education data bases. ' 4 

WHhin the economics and financing of vocational education, two particular 
categories of literature are reviewed. The first is general literature or - . 

school finance. This category is important to cost-benefit analysis since an 
understanding of funding mechanisms is a prerequisite to measuring the costs 
o,f vocational education.. The second' category is l*i teratureron educational ^ 
'efficiency and productivity. This area is surveyed because the methodological 
problems in measuring-education inputs and outputs in these studies are analagous 
to measuring the* costs and benefits of vocational education. . * 

Literature op the methodol ogy fif cost-benefit analysis includes important 
theoretical pieces on both cost-bejief i t analysis- in general, and cost-benefit 
analysis in vocational education specifically. The presentation of literature 
in this area is somewhat abbreviated since the theoretical literature on 'cost-* * 
benefit theory is extensive, and an analysis of this literature is not the 
major i'ntent of. this paper. The d-iscussion is intended to identify majof 
sources* which, can provide the reader with background on the tteory and technology 
of cost-benefit analysis. ^ 

* * . . s ~ 

The third area concerns the application of cost-benefit theory and methodology 
to Vocational education. J Studies that measure the costs and benefits of secondary, 
postsecondary , and adul t /vocational education* are reviewed. 

The final area presents literature that analyzes the ava.ilabij ity and 
quality of data on -vocational eclucation. The literature in this area is limited. 
TJiis (Jearth'is of concern since the sufficiency of existing data is a primary 
determinant of<the feasibility of conducting a* national- cost-benefit study of 
vocational 'education. 

The literature overview* abstract, and bibliography .sections of this repoVt 
are each divided into.the four major organizational a.reafs. Some^ parti€ul ar 
pieces 4)f the research or -1 iterature reviewed in this- project may properly fall 
into more than one area. The study team placed each of these pieces in the 
area considered to'be^f primary importance. In many instances, this -assign- 
ment was highly subjective. v 

1-3 ' C 



LITERATURE SEARCH METHODOLOGY 



' ' In order to- insure. the comprehensiveness of the literature search process,, 
a 'systematic methodology" Was employed using sequential steps. This process is, 
displayed in Figure l.f. First, relevant literature sources were identified 
through consultation with subject matter ^experts and Department of Education^ 
staff, 'a.computer' search of the Education Resource .Information Clearinghouse 
(ERIC), acid manual searches of university and 'government libraries. Each . 
b.ibl iogra phi c "item was then screened by^ asking: 



Is it concerned v)ith cost-benefit theory? 

lies it apply cost-benefit methodol ogies- to vocationa^education.? 



If it is concerned with- the^economics of education or vocational 
education data bases, will it be useful in the design of a cost- 
benefit model? , 
An item was 'placed in the preliminary bibliography if an "^affirmative answer 
was recorded to any of the screen ing)questions . , The preliminary bibliography 
was then reviewed by project^ staffs and subject matter experts for deletion • 
of inappropriat'a-or dated material and notation'of -exemplary sources. This 
sequential process of identification, screening, review, and revision was _ 
• ongoing during the entire course of the study ; _ " • 



• \ 
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Figure 1.1. /Literature Review Methodology 
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SECTION 2 
LITERATURE OVERVIEW 



This section of the report presents an overview of the diverse literature 
related to cost-benefit analysis. Each of the citations is in some way rele- 
vant to the theories and issues in cost-benefit analysis of vocational education, 



The intention of the literature overview is to summarize some of the major^ 
research within the various conceptual areas. Obviously, the ^amount of litera- 
ture yid the d^pth of discussion in an overview format must t>fr restricteid- 
Therefore, this .section presents a broad brush* treatment of tfe -research. 

Greater details available, however, in subsequent sections. The litera- 
ture abstracts -provide more specific inforrfiation on many of the citations noted 
in the overview. The bibliographies paint a more complete picture of the multi- 
disciplinary range of existing liter4£ure. The glossary defines "some of the 
> technical terms used in the overview .^Considered together, these sections 
are designed to provide a general- awareness of the depth of literature related 
to cost-benefit analysis of ' vocational education. * . 

ECONOMICS OF EDUCATION 



To fully understand the intricacies of calculating educational costs, 
some familiarity with school finance mechanisms is necessary: School revenues 
are raised from local, state, and federal sources. The federal role tradi- 
tionally has been limited because funding education was not a constitutionally 
delegated function. However, the federal role has increased somewhat in 
recent years, particularly through categorical programs fojf disadvantaged^and 

handicapped Students. > • f 

> • 

Financing education is consti tutionafly reserved for tShe states which ihave 
instituted a variety of categorical and general aid programs . However, states 
have cjelegated much of the administration and fiscal responsibility toHocali- 
sties. Since localities and states are the major actors in school finance, , 
revenue raising structures are quite idiosyncratic, which complicates the 
measurement of educational costs in a cost-benefit analysis., 




J 

The idi'osyncracies in school funding are primarily reflectejj in- the diverse 
approves taken, by states to finance^ pub'l ic education. The history of 
state aid to education can % be' traced through the writings of Cubb^Hy (1906), 
Strayer and Haig (1927), Mort (1933), Updegraff and Kifig (1922) , and* Morn SQn 
(1930). Cubberly was the first person to seriously challenge the use of flat 
grants to fund" education. He contended that a more flexible system was needed 

. that recogn4zed-^fferences- in--dis-tr-ic±«Jwealth_ancLtax ^effort. The writings of . 

Strayer and ffaig became the basts for the most' widely used of today's state 
assistance programs, the Minimum'Foundation Plan.' Under this, plan, the state 
establishes a level of revenues per pupil that it feels ,is necessary for a- 
satisfactory minimum education program. Using a fixed tax rate, the state 
computes each school district's ability to pay and provides to localities the*, 
difference between this level and the guaranteed minimum level. Much of the 
work of defining an adequate minimal education and the different needs ,of local 
• districts is attributable to Mort. Updegraff and -King advocated a variation of 
the Minimum Foundation Plan call ed~Percen*Ccige Equal i zing wh^e Morrison supported 
. full state assumption of educational funding, a plan which has been implemented * 
only in Hawai i . * 

Interest in school finance increased dramatically after the Cal i fornia^ ' m ■ 
, Supreme Court initially ruled in the % 1 971 case of Serrano- v. Priest . The 

.Court contended, that toe state's school finance structure was unconstitutional * 
since severe revenue disparities existed between school districts. The primary 
reasons for these revenue disparities were a strong reliance on the local property- 
tax for educational funding and large inequalities between local i ties. lV 
property tax base. The Serrano case prompted Berke_ and' Kirst (1972) to documents 
the extent of revenue disparities across the -country. and to prescribe mechanisms 
to finance equal educational opportunity. An outstanding overview of the prob- 
lems and remedies, in sch.ool finance appears in Reischauer and Hartman (1973J. 
Other excellent texts on the funding of publ ic -school s were authored by Johns, 
Alexander and Jordan (1972) „ Berke, Campbell, and Goettel (1972), and Cohn (1974). 

'McLure (1976) discusses school finance issues^ relation to's'pecial educa- 
tion programs in IITTttots-. This analysis includes an evaluation of the adminis- 
trative, and financial structures of vocational and bilingual education, as well 
as more tradi tionafly defined special . education program^such as those for 
learning disabled and handicapped students. 
• * . ' # 2-2 • \ 
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An additional area of research performed educational economists that 
should be reviewed by those interested in cost-benefit analysis is production 
function studies. Since cost-benefit analysis is essentially an input (costs) - 
output (benefits) methodology, it shares many of the same 7 problems as educational 
production function research. 



A production function analysis relates quantities of inputs to one or 
more outputs. This technique is used primarily by 1 educational researchers 
\to identify what educational inputs ('e.g.' -teacher experience, school facili- 
ties, student-teacher ratio] have the greatest influence on educational output. 
The most well known of this type^f production function study is Equal i ty of ^ 
Educational Opportunity (Coleman, 1966),. - t~ 

\ • f * 

Among the common concerns of cost-benefit and production function. method- 

"V. 

ologies is control 1 ing for non-educatjonal variables that affect learning 
levels. These variables include innate ability (often measured by I'.Q. scores] 
the richness of the home environment (measured, for example, by the number of 
books and magazines in the home), and'family background (often measured by 
parents 1 'income and educational background). * 

In cost-benefit analyses that compare the returns of vocational education to 
those ^bfjnon- vocational ^educati on, a basic consideration is selecting comparison 
groups nT&t are similar tf op these infl uential 1 non-educational variables. Since 
matching Vocational students with gen'eral education students on social back- 
ground variables is difficult, researchers often utilize regression techniques 
to control for non-educational impacts. 



In production .function research, analysts are 'faced with the similar 
d'ilenima of partialing out confounding non-educaticfhal variables in order to 
examine the contribution "of alternative educational inputs ^to educational 
performance. This* is done primarily by regressing educational output against 
a variety of school and non-school variables. For exampTe, Bowles (1970) 
hypothesizes an educationa/I production functiofi as: 
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A = f(X 
A 



\ X m > 
v m 



X ) , where . 



School output 



. . X = School inputs 

. M . X = Non--fchoo1 environmental infjuences 
/ / u 

. . X = Student's initial learning level prior to 
z entering school 



By statistically controlling the regression analysis for non-school environmental 
influences and a student's initial learning level, Bowles separates out the 
effect of school inputs on output and' measures the "value added"* by these inputs. 

A second common concern of production function and cost-benefit analyses 
is measuring the end-products of the educational process. 1 In cost-benefit analysis, 
one primary measurement di ff i^ul ty^ is operational izing non-pecuniary, as opposed 
to economic*, benefits. In production function research, the methodological 
problem is identical but the terminology is different. Res'ea'rchers find it • 
difficult to measure the consequences, outcomes, or final' goods of the pro- 
dumon /process (such .ak non-cognitive educational skills) while they are much 
more successful^ in measuring the direct outputs or intermediate goals of the 
production process (such -as test scores arid dropout rates) ^Bradford, Ma1,t, and 
Oates, 1969). . % 



-A third problem shared by the two methodologies is controlling for differ- 
ences in program quality. It is theoretically inadequate merely to compare the 
quantity of output of various.<educatjonal programs since the quality- of the 
outputs may differ also. Both production function and cost-benefit researchers 
have attempted tcyadjust ^for quality differences by introducing proxy variables 
such as pupil/teacher ratio and teacher experience on the input, side of the 
regression equation. An outstanding discussion of this process and its 
methodological limitations is found in Ross and Burkhead (1974). 

• Numerous production function* analyses exist; using similar., regression 
techniques but varying in their measures of educational outputs ai)d 'inputs, 
quality proxies, data bases, >and levels bf sophistication • Many of these, 
studies (Burkhead, Fox and Holland, 1967; Katzman, 1968; Shaycoft, 1967) 
analyze production functions .for schools in various cities. Others (Cohn, 
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1968; Raymond, 1968; Kiesling, 1970) use school districts rather than schools 
as the unit of analysis. The Shaycoft study is unique because i t -used 
longitudinal data. Shaycoft utilized Project Talent data to accumulate in for- 
mation on 6,583 ninth grade students. Hfe- later gave these same students a 
variety of achievement .tests when they were in the twelfth grade. Noting the 
rise in achievement whi Ve controlling for socioeconomic status, Shaycoft con- 
cluded that 's-chool ing do,es affect pupil performance. 

Amohg the more sophisticated input-output designs are a series-of studies 
that create v simul taneous equations to analyze production (Fox, 1969; Levin, 
1970; Michelson, 1970; Averch and Kiesling, 1972; Brown, 1972). In a study of 
educational production in Chicago school s Fbx used ttiO measures of school 
output, with each dependent variable efttgring the other equation as an^nde v 
pen-dent variable. The l/gic behind this methodology is that the multi[5le^ 
goals of an education system ar'e^ interdependent and, therefore^ schools trad 



off between the alternative outputs. Michelson and Brown J)oth used two-stage 
least squares to estimate their simultaneous equations. Levin used two-stage 
least squares, ordinary least squares, anjd reduced form ^estimates . ^ 

One studj created a non-linear production function similar to a Cobb- 
'Douglas equation (Hanushek, 1970). Hanushfik" regressed verbal scores against 
twelve socioeconomic and school variables using a double log specification. 

There are so many commonalities between cost-benefit and production function 
techniques that the preceding literature can be extremely useful in the , 
design of cost-benefit models. A raview>and cri'tique of much of this work 
may be found in Averch, Carroll, DoriVldSon, KfesTiag, and Pincus (1974). 

"COST-BENEFIT AND EDUCATION EVALUATION THEORIES . „ 

. Cost-beneTtfc^analysi s is a sophisticated evaluative technique. One of 



the mo^fe interesting presentations of the methodological components of cost- 
benefit ana-lysis as well as the uses, problems, and limitations of the technique 
is Miskian ( 1976). Mishan discusses such issues as oppoN^m ity costs , shadow 
pricing, externalities, and discount rates. Other general discussions of cost- 
benefit methodQlogy include Prest and Turvey (1965), Rothenberg (1975), Musgrave 
and Musgrave (1976), and Sum, Mazyed, McLaughlin and Zornitsky (1978). 



' » i ' 

Hu'and Stromsdorfer (1979) 'analyze many of the problems in cost and benefit 
measurement of vocational education. Of particular interest is their contention 
that joint costs are^not a measurement problem in^ cost-benef i t analysis. Uhey 
N explain ; that whei/a school is operating at less than capacity, use of a . facility 
by one person ddps not preclude use of the facility by another. Therefore, 
the marginal cost of using the facility is zero, and' adjustment for joint 
costs is unnecessary. ' > 

Davie (1967) explains three criteria for making benefit-cost decisions in 
the context of vocational education: the present value of net benefits, the 
rate of return, and the benefit-cost ratio. .Kaufman (1969) discusses the logic 
and meaning, misconceptions, and problems and limitations of the methodology 
in vocational education. Stromsdorfer (1967) e/plains, among other issues, 
the confutation of opportunity costs, the problems in selecting a discount rate,, 
and mi danger of double-counting the benefits of vocational education since 
. such intangible benef.its_as increased mobiJity may be already reflected by 
increased earnings . . 

tardus, 'Fuhrer, and Thrall (1980-) write irfXhe area of rehabilitation re- 
search rather than vocational education. However, they suggest some means . 
of measuring non-pecuniary benefits which should be of interest to voca- 
* tional educators. JtertSpeCuniary benefits have traditionally been the major 
measurement difficulty in cost-benefit analyses of vocational education. 

\ 

. — Hansen and-Weisbrod (1969) discuss cost and benefit measurement in rela T 
v tion to public postsecondary education. Other studies presenting the principles 
of cost-ben%fit , analysis in the context of vocational education are those of 
Peterson (1969) and Reihhart-and Blomgren (1969) 

A methodology that parallels cost-benefit analysis is cost effectiveness 
•research. The primary difference between the. techniques is that cost-effective- 
ness analysis expresses results in terms of physical or psychological outcomes 
rather than economic values. The theories and applications of cost-effectiveness, 
are explained by English (1968), Forbes (1974), Levin (1975), and Blaschke and 
. - Sweeny (197frf " $ * 

1 * 

** 
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Kim (1976 and 1977a) has designed models that combine techniques of cost- 
benefit analysis with those„of cost-effectiveness analysis c These mfrtel s ca n 
•generate three kinds of program measures: program effectiveness, cost-efficiency, 
and a cost-effectiveness and performance ratio. He has developed separate 
theoretical models for secondary and postsecondary vocational education. 

in order to perform either cost-benefit or cost-effectiveness analysis, 
measurable benefits of the vocationaV'education process must be specified. 
Darcy (1980) contributes t9 this identification process by defining*15 voca- 
-tional education outcomes and discussing their use in evaluation research. 
These benefits are both economic and non-economic, and some can be tmeaStired far 
more accurately than others for research purposes. Two research efforts that , 
help identify primary methodological issues on the cost side of cost-bene.fi t. 
analysis were conducted by Hale, Starries, and Mickler (1977) and Mohrenwe'i ser (1979) 

) 

COST-BENEFIT APPLICATIONS IN VOCATIONAL EDUCATION 



Numerous researchers have applied the concepts of cost-benefit analysis to 
vocatio/ial education. A number of very useful reviews of th<is literature exist 
/warmbrod, J968; Stromsdorfer, 1972; Adams, 1972; Hu, 1980; and Mertens, McElwain, 
Garcia, and Whitmore, 1980). Hu's -paper investigates some of the major measure- 
ment problems in- cost-benefit analysis of vocational education and summarizes 
^the literature. Mertens, et al. surveys existing cost-benefit literature in 
the process of analyzing whether research findings* are consistent concerning 
the impact of vocational education on* certain , output variables. A separate 
review is performed for secondary and ^postsecondary vocational, education.* 
Adams presents an excellent overview of research on adult vocational education ' 
prior to 1972. \ > 

" ■ ■ / ' 

Until the early 1970's, most cost-Benefit studiers limited -their scope to 
analyzing the effect of vocational education in one gpr more cities. Corazzfni 
(1966,)) for example, examined the costs and benefits of public vocational educa- 
tion in Worcester, Massachusetts. Kaufman and Lewis (1968) focused on three ( 
Pennsylvania cities. Taussig (196&V compared the impact of vocatioWkjurtk^ 
academic high school programs in New York City. Hu, Lee, . Stromsdorfer , and Kaufman 
(1969) contrasted the returns from secondary vocational ' education witii compre- 
hensive secondary programs in Philadelphia*; Detroit, apd Baltimore. 

O . • 2-7 ir 
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Jhes,e studies have been followed by numerous analyses on a statewide basis. 
These include cost-benefit analyses in Michigan (Conn, Hu, and Kaufman, 1972), 
Florida (Harris, 1 972), Kansas (DeVore and Scott, .1974) / Wisconsin (Webb, 1974), 
Missouri (McNelly and Kazanus, 1 975), Illinois (Nystrom and. Hennessey , 1975), 
Ohio (Ohio State Department of Education, 1975'), New Jersey (Doty, 1976), and 
Massachusetts (Conroy and Diamond, 1 976) . 

Only a handful of studies have been attempted that are more national in 
scope. These include Fernback and Somers (1970), Eninger (1972), and Lee (1976) 

Although studies .of secondary vocational education predominate in the' 
literature, there are a variety of important postsecondary afidjadujt analyses. 
Carroll "and Ihnen (1966) studied the.economic effects of techlffoaj education 
at a two-year postsecondary school in North Carolina. Include^ in the analysis 
performed by Marson, Weiner, and Sorenson (1977) are 63 adul t -educati on courses 
from three vocational schools. Works by Koch (1972), Osburn and Richardson 
(1974), and Kastner (1976) are representative of other adult and postsecondary 

studies'. " • 

* x .. 

The cost of vocational education may be measured using either average— 
cost <m marginal cost methods . Most of the research to date, whether secondary, 
postsecondary, or adult analyses, measures the costs of vocational education as 
average costs. Among the analyses employing marginal cost methods are Cohn, 
Hu, and Kaufman, Osburn and Goishi (1974), and Swanson (1976). 

v The issue of joint costs js considered in a limited number of studies^ 
Aldrich (1972) proposes three alternative criteria for calculating joint^ 
costs: the number of student credit hours, the number of full-time equival- 
ent faculty, and classroom square footage. Hu, Lee, Stromsdorfer , apd^Kaufman 
ignore joint cost .measurement because they belive that one student utilizing 
a facility does not deny similar usage by other students. Therefore, the 
joint costs are equal to the marginal costs of facility usage which are zero. 

Oa the benefits side, measurement difficulties have limited the majority 
of analyses to the consideration of economic benefits only. Economic benefits 
are predominately measured by the level of worker earnings. Hu, lee, * 
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Stromsdorfer 'and Kaufman, and Swanson, utilized both earnings and wage rates as 
measures of economic benefits. , 

Hamby, Harper,- and Myers (1978) performed a cost-benefit analysis in k 

Montana that did attempt to include non-pecuniary benefits. These were measured 

by perceptions of vocational and non-vocational students on the utility of 

their training, by employers' assessment of the quality of their employees' 

« 

training, and by comparisons of tire**' vocational and non- vocational students' 
perceptions of the quality of their fife. 

Hu, Lee, Stromsdorfer, and Kaufman likewise included measures of non- 
pecuniary benefits in their research. They utilized citizenship (measured* by 
voting participation) ancTjob relatedness, to one's , education program. Their 
findings show that vocational education is more «job relevant than non-vocational 
education but that no differences exist between vocational and non-vocational 
graduates in voting participation . 

Marson, Wein,er, ancTSorenson developed numerous measures of private and 
social non-pecuniary benefits for their study on vocational -technical adult 
education graduates. These included student study habits, personal ity. traits, 
sel f-assessments of ability,* attitudes toward education and employment, help 
from the school in job placement, permanence of job, job satisfaction, involve- 
ment in community organizations, number of promotions, and length of job search. 

Galloway an (J Ghaz'alah (19720 also measured the impact of vocational educa- 
tion on non-pecuniary benefits. Their measures included fob satisfaction, 
work attitude, communication skills, interpersonal relationships, and self- 
confidence. 

The Swanson and the Kaufman and Lewis studies used job satisfaction as a 
measure of no/i-pecuniary benefits. Karnes (1966) used holding power, which is 
the inverse of the dropout rate, as* a measure cff educational benefits in his 
study of the impact of vocational training on slow learners who are potentially 
high dropout risks. Other studies employing various measures of non-pecuniary 
benefits were performed by Eninger, Webb, Lee, and Harris. 
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. The findings of many studies highlight the dangers of over-aggregation in 
cost-benefit analyses. Results very often differ by program area, level -of ■ 
education, type of institution, and sex of the student.' For example, Cohn, . 
hu, and Kaufman (1972) found that the added costs of secondary vacational 
education (costs_aJas*e those necessary' to fund non- vocational education) vary 
greatly by program area. ■ The^verage added cost of a welding curriculum was 
,3365. However, a home economics" curricul urn actually costs $15 less than a ■ 
general education curriculum. In his comparision of the costs of a basic high 
school curriculum with a vocational curriculum, Corazzjni found that there were 
differences between the cost cff vocational education programs selected by boys 
and by girls. Conroy and Diamond's results show that male vocational graduates 
earned more and found jobs more quickly than non-vocational program graduates. 
No differences were observed on these variables between female vocational and 
general education Students. Fernback and Somers 1 data suggest that while the 
net benefits of secondary vocational programs were positive, they were negative 
for postsecondary vocational training. Harris' research found that the rates 
•qf return of vocational education differ between secondary- and postsecondary 
programs. He also showed that rates of retuf^n vary by program area. Swanson 
concludad that the efficiency of vocational training, calculated as benefit- 
cost ratios*, varied- By program area. While many' trainirig programs had positive 
benefit-cost ratios, the ratios for some particularly costly programs were negative. 

x The conclusions of cost-benefit studies of vocational education vary over 

time. The early studies concerning the'inf 1 uence of vocational education on 
-earnings were inconclusive. Taussig, for example, found the rite of return on 
investment in vocational education to be.quite small and the present value of 
benefits to be negative. However, ^Eninger's early study showed a rate of 
return twice asVjreat as Taussig's and a positive net present benefit of $307 
per student. 

f ' L ' ' ■ 

Later ^studies , however, have consistently demonstrated that* the economic 
returns f rom \ocational draining are positive. For example, McNelly and / 
Kazan us calculated benefit-cost ratios for secondary vocational education as 
high as ten to one. Kocjh, estimated the private' rate of return of postsecdndary 
vocational training as 12.3 percent. Other studies conclude that vocational 
"education c4n lead to increased earnings, greater job satisfaction, greater 
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levels of employment, reduced job search time, and higher overall satisfaction 
with one's .educational program. 

"3 

VOCATIONAL EDUCATION DATA^SOURCES' 

t 

The decentralized structure of the American education system often creates 
data di fficuTn~es _ for~ eWcTTi^n^Te^llja"tors and cost-benefit study teams-. 
Data quality and data availability vary sharply across states and even within 
states. There are a number of resources that review the availability and 
quality of vocational education data. 

Brown, Barnes, Currence, and Henderson (1980) are the authors of an Office 
of the Assistant Secretary for Planning and Evaluation overview of vocational 
education research and data sources. They. found a distinct difference $ 
between data bashes. Of superior value, according to the analysis, are the 
High School and Beyond Longitudinal Survey, the National Longitudinal 
Study of the High School Class of 1972, the*Berkeley Survey of Vocational 
Schools in 10 StatVs, and the 1966 National Longitudinal Survey. Rated par- 
ticularly .deficient are the Bureau of Occupational and Adult Education Annual 
Statistical Reports and the Vocational Education Data System (VEDS). The 
conclusion concerning VEDS is most interesting since the, data collection 
system was designed ^overcome many existing data problems. 

Lee (1979b) descri bes^ the characteristics of vocational education data at 
the local ,\ state, and Federal levels^. In the process, he discusses the reasons 
for the highly inconsistent quality of vocational education data. Lee (1979a) also 
discusses how vocational educators can use, existing evaluative data. 

Hopkins (1979) summarizes the information needs, data sources, and data 



deficiencies in vocational education. Of pa-rticular use is an appendix which 
matches various* data elements with the data sources in which they are available. 

i 

;Grasso and Shea (1979) review the availability of data from several national 
surveys. Included in their discussion are the Project Talent .Data Base, Youth 
in Transition, tfie National Longitudinal Surveys; and the National Longitudinal 
Study of the High School Class of 1972. 
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Other surveys of. data 'availability or discussions of data sources ma# be 
found in work by Vatz- ( 1 976) , Pucell (1979), and Woods (1980). The latter 
two sources are concerned with the use of longitudinal data sets in vocational 
education evaluation. . 

A second category of -useful literature discusses the existence and future 
potential of management information systems in .vocational education. Morgan, 
Ballenger, and Lawrence (1974) and Starr, Black, and Gray (1977) both surveyed 
the "availability of vocational education management information systems on a 
national level. Mendenhal 1 • (1977) writes about the vocational education infor- 
.mation system in the State of Nebraska. 

Various documents discuss the use of garticular vocational education data • 
sets. "For example, Flanagan, Dailey, Shaycoft, Orr, Ind Goldberg (1 962) 
wrote about the Project Talent da'ta. Other pieces describe the Youth in Transi- 
tion data (p'Malley, Buchanan, an\i Johnston, 1977); the National Longitudinal 
Survey (Fetters, 1975; Tabler, 1976); the National Longitudinal Study of the 
High School Class of 1972 (Echternacht, 1975); and the Project Baseline Data 
(Lee, 1974, and Peng, Stafford, and Talbert, 1976). 

Ghazalah (1981) proposes that evaluators of vocational education and cost- 
benefit study teams utilized a greater degree existing sources of data rather 
than data collected through personal surveys. One underutilized data re- 
source is U.S. Individual Tax" Returns filed with the Internal Revenue Service. 
Ghazalah shows how these data can be used as a source of vocational student 
earnings as well as providing proxy variables for employment/rates and 
.interregional mobility. • ' 
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' SECTION 3 
s • ABSTRACTS 



■v 



This section abstracts some oi the m%jor literature pertaining to cost-benefit 
analysis. The selections are representative of the diverse literature that can assist 
planners of a national ^cost-benefit study of vocational education. 

The choice of citations is -intended to reflect this diversity. It is not 
meant to provide 'an exhaustive listing of the, primary sources related to measuring 
the costs' and benefits of vocational education. Rather, the titles are a sampling 
of this primary literature. , ^ . „ * 

The abstracts serve two purposes. First, they provide greater depth of 
information than is, possible in the overview format. Second, the content 
summaries can direct "readers to resources that match their particular information 
needs. , y * 
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Averch, H. A., Carroll, S. J., Donaldson, t. S., Kiesling, H: J. and Pincus, 
J. How Effective is Schooling?: A Critical Review of Research . Englewood 
'Cliffs, NJ: Educational Technology Put/I ications , 1974. 

3 

This^ource summarizes the paramount methodological! and measurement issu^ 
in relating school inputs to educational outputs. For example, the authors 
discuss alternative definitions of school output. They note that various student 
test scores are the most often used output measure. Although these tests do^ 
measure certain important aspects of the learning process, the authors^contend 
that they have severe limitations as well. Student test scores appraise only " 
a limited range of the many cognitive abilities learned in school,. Also, they 
are often culturally biased and do not accurately- measure t'he skills of 
minority groups . 

Averch, et al. also review the various methodologies for measuring the 
productivity of educational resources. They discount the* policy relevance of 
process techniques that attempt. .to measure the variations in the effect of the 
schooling process :( teaching methods, curriculum, etc.) on output through 
laboratory observation. . They write: 

Sometimes, to minimize the extent to wjvrdi a student's previous 
learning experiences' affect the outc&me of an experiment, they 
deliberately examine learning tasks that ^are very unlike the 
learning tasks encountered in the classroom—memorizing lists of 
nonsense syl lables , ' for example. Consequently, the results of 
the experiment offer little direct policy guidance. 

The authors discuss the production function methodology rather -thoroughly . 
Perhaps their principle contribution "in this area is an extensive overview of 
the production function literature in education. Of particular usefulness 
js an appendix. that individually summarizes the methodologies, variables 
used, and 'findings of much of this literature. 
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Benson,* C. S. 
Delta .Kappa, 



Ejduc 
Indk , 



ucation Finance in the Corning Decade. Bloomington, IN: Phi 



1975. 



>mjjr 



Benson begins his book by briefly il 1 ustrating the sources of school* 
funding, the extent of school 'ex-pendi ture disparities, and available measures 
of education outcomes . He then presents three major themes. The first is a 
disgussioaof family choice in selecting the level and quality of educational 
services. He discusses the principle of "voting with ones feet" and theorizes 
on the potential impact of educational vouchers on family choice. • e 

The .second theme is whether and how various educational resources can be 
more efficiently combined to increase school outpfut. Under this heading; Benson 
discusses whether the level of school revenues can affect the quality of educa- 
tion and whether educators can determine how much money is necessary to run the 
publ i<^school s . . . « . 

Thi rd?sf?&&son su)\eys the primary j,ssues in school finance. He writes, 
on the meaning^B educational equity, the impact of the^courts on educational 
funding, and thlfeossible effect of two reform alternatives, district power 
equalizing and fjfl state funding, on the distribution of* school dollars. 
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Berke, J. S . , jCampbel 1 * A. *K. and GoetteT, R. J. (eds.). Financing Equal 
Educational Opportunity . Berkeley, CA: McCutchan Publishing Corporation, 1972. 



The articles in this book were developed to assist the New Yonk State 
Commission on the Quality, Cost, and* Financing of Elementary and Secondary 
Education (the "Fleischmann Commission") in developing new approaches to School, 
finance in the state. " Berke begins the book with an overview of the major 
issues in school finance. Other chapters address the particular .sources of 
inequalities in New York State funding mechanisms, potential school finance 
programs in the state and a simulation of the impact of such reforms, the 
possible effect of a regional approach to school fundingon revenue disparities, 
the potential impact of full state assumption on existing inequalities, the 
degree of funding inequalities in urban school districts, aad a methodology 
to measure the match between educational revenues and the level of need in 
individual 'scho'ol districts. * » 
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Blaug," M. Economics of Education: A Selected Annotated Bibliography . New 
York, NY: .Pergamon Press, 1978. 1 

. J . . . 

This is the third edition of -a'eri tical annotated bibliography of literature 
on the economics of education. The bibliography is largely confined to published 
literature (in English,' French, and German) with the exception of certain 
mimeographed papers whi£h can be' obtai ned' from various international agencies 
and institutions on request. ^ • ' J - 

*13kug classifies the literature under five major chapters and according 
to two basic distinctions, developed and undeveloped countries' The chapters 
and subheadings pertaining to developed^ courHries are: 

• general Surveys 

• The Economic Contribution to Education 

- Eq^rl ier Views " 

, - Jhe Production function Approach ■ ^ 

- Human Capital Formation 

- Measurement of Return 

• • The Economic Financin^of Education w * . 

- Higher Education > . 

- Public and Private fwnance \ 



- Productivity and Efficiency * ^ ^ 

- Technical and Vocational Education 



t » 

The author notes that the classification scheme is somewhat arbitrary 
and cross-references are provided for items which could be classified under 
multiple headings. A chronological rather than an alphabetical listing is 
adopted in order to demonstrate the development of the sVibject over the years. 
There is an alphabeticM index of authors for easy reference. 

The" author introduces each chapter with a'brief summary and critique of 
the works' listed, alonq with a commentary on the state of the art of literature 
in that particular topic area. In- his overview of the body of literature on 
the economics of education, Blaug notes that the literature has been growing . 
at an* accelerated rate since 19£0- Since new material is continuously appearing, 
it is the author's intention to keep. the bibliography -to -date through 
further .edi tions . -* ' . 
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Burkhead, J., Fox, T. and Holland, J. Input and Output in Large City High Schools 
Syracuse, NY: Syracuse University Press, 1967. 

. Jhis book reports the research^ findings on the education production func- 
tions for schools in Chicago, Atlanta, and the Project Talent data base. In 
their analysis, Burkhead, Fox, and^ Holland measured educational output as achieve- 
ment test results, I.Q. scores, dropout rates, and intent to attend college. 
The independent variables included various educational and non-educational, 
inputs. A regression analysis was run separately for each grouping of schools. 
The authors generally fjjund that both school and non-school variables do affect 
educational output. HpQever, the identification of significant input variables 
and the level of association between inputs and outputs vary between samples 
and output measures. . 
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Cohn, E. Economics of State Aid to Education . Lexington, MA: D. C. Heath and ; 
Company, 1974~ 



« 



Cohn's book has two principal components. The -first discusses the history 
and technology of state aid to education. In this section, the author describes 
the -origins of our present practices of school finance and discusses the role m 
of early influential school finance scholars such as Cubberly, Strayer and 
Haig, Mort, Updegraff, and Morrison. He also writes on the varying defini- 
tions of educational equality and presents a thorough review of the alternative 
formulas used by states to fund education. 

The second component is an empirical analysis measuring the impact of state 
aid on school size, per pupil expenditures, enrollment rates in nonpublic 
schools, per pupil bond issues, and per pupil local revenues. Cohn performs 
his analysis on both interstate and intrastate levels. Among his conclusions 
are that state aid tends to increase the total level of school expenditures 
but decrease the amount of local expenditures; is negativel'y related to 
nonpublic enrollments, local revenue, and bond sales; and is positively 
related to average school size- Cohn follows this empirical analysis 
by suggesting reforms that can potentially increase the efficiency of 
school expenditures. 
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' Coleman, J.<S., et at. Equality of Educational Opportunity . Washington, DC: 
U.S-. Department of Health, Education, and Welfare, Office of 'Education , 1966. 

Commonly referred to as the Coleman Report, this research is the most well 
known and widely cited of the input-output studies in education. Coleman and 
Tins colleagues measured the impact of a pupil's social environment and his/her 
educational training on student performance. They concluded that "schools 
bring little influence to bear upon a child's achievement that is independent 
of his background and general social context." > 

Coleman's findings on the lack of influence of the schools on output 
have been harshly criticized on methodological grounds. To reach 
these conclusions, Coleman employed multiple regression analysis entering 
variable clusters in a predetermined order. Socioeconomic status, variables 
were consistently entered into the equation first, followed by school variables 
Due to a high intercorrelation between many of Coleman's independent variables, 
the order in which the variables were entered .into the regression may have 
^biased the findings. Whatever variance in the dependent variables that was 
explained by the i ntercorrelated independent variables was attributed to the 
first cluster of variables, in this case the socioeconomic variables. The 
impact of the school variables was likely severely underestimated. Even with 
this bias, several school variables were found to be significantly related to 
pupil performance. The highest explanatory effect among school variables was 
the verbal -ability of teachers. 
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Garms, W. I., Guthrte, J. W. and P^rce, L\ C. School Finance: The Economics 
and Politics- of Public Education , Englewood CI i ffs; NJ: Prentice-Hall, Inc., 
1978. 



This is a comprehensive overview of school finance and the economics of 
educations the elementary, secondary ,- and postsecondary levels. Among the 
themes discussed are how to combine educational resources to maximize efficiency, 
the equality of the distribution of educational benefits, the impact of various 
school aid formulas, and the application of economic theories and methodologies 
to education. 



of 



More specifically, this text discusses such issues as: 

The potential tradeoffs between the^educational policy goals 
equality, efficiency, and liberty. 

The role of local, state, and federal governments in education. 

The relationship between school organization and educational finance 

The impact of collective bargaining on educational finance and 
governance. 

The characteristics of the taxes used to fund education. 
The goals of federal education policy. 
The status of state funding schemes. 
The impact of the Serrano case on school finance reform. 
Problems in increasing school productivity. 
School district management and budgeting procedures. 



The technology of school finance reform^ 
The role of' citizens in school finance reform. 
The management of capital. / 
The impact .of school finance on urban schools. 
The financing of higher education. ^ 
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Grubb, W. N. and Michelson, S, 
and Company, 1974. 



States and Schools. Lexington, MA: D. C. Heath 



Grubb and Michelson present a thorough overview of the history, definition, 
and technology of educational equality. In the process, they describe the 
status of educational equality in the -states and how the structure of state 
aid has contributed to that status. The authors follow up this theoretical 
discussion with an empirical model of intrastate public school finance. 
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Katzman, M. T. "Distribution and Production in a Big City Elementary System." 
Yale Economic Essays 8 (Spring 1968): 201-256. 



In this article, Katzman estimated production functions for 56 schools 
in Boston. Amorg his output variables were three measures of school holding 
power. Holding power is usually defined as the inverse of the dropout rate. 
Katzman measured it as .the percentage of students registering at the beginning 
of the academic year who remain through the year, average daily attendance as 
a percentage of average daily membership, and the dropout rate of elementary 
school alumni'. He also measured pupil performance' by second and sixth grade 
reading scores and the percentage of students passing the entrance exam for 
the prestigious Latin School. 

' Katzman entered the following input variables in his production function: 
class size, percentage of students in crowded classrooms, student/staff ratio, 
number of students in the school district, percentage of teachers with permanent 
status, percentage of teachers with* masters degrees, percentage of teachers 
with one to ten years experience, 'percentage of annual teacher turnover, and_ - 
an index of cultural advantage. The creation of. a cultural advantage index is 
one way to overcome mul ti col 1 i neari ty among various socioeconomic variables- 

Katzman found that the index of cultural advantage, size of the school 
district, teacher experience, and student/staff ratio all affect educational 
output in at least one equation. However, none of^the variables were significant 
in all output equations. 




> 

3-14 , - 



McLure, W. 
Structures 



P. Special Programs in Public Schools: Administrative and Financial 



Urbana-Champaign, IL: University of Illinois at Urbana-Champaign, 

Bureau of Educational Research, 1976. 



McLure a-nd his staff examine the administrative and financial structures 
of special education programs in Illinois. Included in the analysis are 
vocational education and bilingual education programs as well as (nore tradi- 
tionally defined special education services such as those for learning disabled 
or handicapped children. This discussion of the finance and governance of 
special education programs in Illinois provides good background on the issues 
and problems faced in many states. McLure concl udes^wi th a presentation of 
recommendations 'to improve further .the finance .^nd governance systems in Illinois. 
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Pincus, J. (ed.). School- Finance in Transition . Cambridge, MA: Ballinger 
Publishing Company, 1974. ~ 



Pincus has compiled and edited a series o/^Vticles Vy school finance 
scholars on a diversity of funding issues. The book contains chapters on: 

* Al teVnati ves to existing funding mechanisms.* 

* The impact. of the courts on school finances 

© The influence of school finance reform on tax policy. 

i ' " i 
9 Effects of -school resources pn educational outcomes. 

* » •* 
® The politics of school finance. \- % 

e The influence of school finance problems on broader social issues 
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Reischauer, R. D».and Hartman, R. W. 
Tfte Brookings Insti tution,^1973. 



Reforming School Fipance . Washington, DC: 



Reischauer and Hartman's book is^a classic textbook treatment of, the primary 
issues in school- finance. Ttie authors f i rst <tiescri>be the causes of the fiscal 
dilemma in funding education. Jkey attribute the crisis partially to the rapid 
rate of expenditure increase since 1960 that was prompted' by increased enroll;-" , 
ment and rising prices. A second determinant was the inability^to squeeze 
increased dollars out of traditional revenue raising structure^* School funding 
re-lies heavily on the local property tax. Many citizens felt this tax was re- 
gressive and already too high, and therefore, refused to votgytor increase^ 
spending in school budget referendums. 



The authors also present data on the extent of revenue and expenditure 
disparities between states and school districts. They discuss mechanisms to 
reduce these disparities such as larger state equalization programs, full state 
financing, capacity equalization, and federal intervention. They also explain, 
in a separate chapter, the fiscal and enrollment problems that face non-public^, 
schools* : « J 
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Ross, J. P. ana Burkhead, J. Productivity in the Lo cal Government -Sector . * 
Lexington, MA: D. p. Heath and Company, 1974.- . 



In this book, Ross and Burkhead explain the definition and measurement" 
ot public sectorlproductivity. They discuss the difficulties in relating . 
•quantities of inputs to the level and quantity of output of public services. 
They also explain the impact of alternative definttions of productivity 
on measures of the efficiency of production, survey various methodological . 
approaches to the measurement of productivity, and review examples 'in the 
literature that attempt to measure productivity. Although the presentation 
does not fo.cus bn educational production per se, it is highly relevant to tbis 
area, and does apply many of the theoretical issues to the measurement of 
educational productivity. . ^ 

The authors' also deveftJpta methodology for analyzing changes in government 
-expenditures. This 1 methodology is applied to four service areas: education, 
welfare, police, and fire. TfTe data utilized are from New York State. ^ « 
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Sacks, S. City School-Suburban Schools: 
Syracuse, NY: Syracuse University Press, 



A History of Fiscal Conflict . *J 
1972.* 



Sacks presents many 
a model to determine the 
tures. The determinant ( 
income, the proportion of 
ratio), and the level of 
performs his analysis for 
assess the degree of the 
findings are: 



of the important issues in school finance while Huilding 
determinants of per pupil current educational expendi- 
independent) variables in the model are per capita 

the population attending public schools (enrollment 
state elementary and secondary school aid. Sacks 

urban school districts and suburban districts to 
bias against cities in sghool finance . Among Sacks' 



Differences in average income between urban and suburban communities 
are a determinant of disparities in per. pupil expenditures. 

The level of state aid affects the overall level of expenditures 
within a state . j 

The relationship between the proportion of a district's children 
attending public scfjpols and per pupil expenditures is negative. 

4 / ' 

State aid is additive and n ( ot substitutive, but does tend to reduce- 



local effort. 
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COST-BENEFIT AND EDUCATION 
EVALUATION THEORIES 
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..Cardus, D., Fuhrer, M. J.,, Thrall, R. M. , et a 1 . A Benefit-Cost Approach to 
-the Prioritization of Rehabilitative* Research . Houston, TX: ^Baylor College 
♦of Medicine, The Institute" for Rehabilitation and Research, 1980. 

This work represents the findings of a research effort, begun in 1971 with, 
the purpose of constructing "a mathematical evaluation model that would take 

* into account both the monetary and non-monetary benefits of rehabilitative 
research." As a, result, Cardlis, Fuhrer, and Thr.aTl have deVelopeaa model 
with aspects which are directly relevant to a cost-benefit analysis of voca- . 
tionalaeducation . 

Cardus, Fuhrer, and, Thrall propose a multidimensional model, measuring 
groupings of costs and, benefits along unique dimensions.^ For example, the 
monetary benefits resulting from vocational education would be measured 
along one -dimension while nonpecuniary benefits could be Measured on a^different 

* scale along a unique dimension. These different measures would be summed as 
a function, of a group of parameters determined by the policy maker. 

The report has chapters on operational izing the terms of the proposed 
cost-benefit model and implementation of the model. A chapter is also pro- 
vided detailing a systematic process to weigh the various benefit dimensions. 
The report ends with two appendices . One details the process used to cluster 
benefits while the other appendix provides an excellent discussion on the 
appropriate methodological approached to relate costs and benefits. 
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Darcy, R. L. Some. Key Outcomes of Vocational Education: A Report on Evaluation 

jares . Columbus, OH: Ohio S 
VocationaT^Etiucation, 1980, 



' Criteria, Standaftgs, and Proce dure! . CoJjjmbus, OH: Ohio State University, The 
National Center for Research 



Tms study discusses the use of outcomes as a mcasuremftl, flfcl in evaluating 
vocational programs. The focus is upo'ft fifteen outcomes artfvtheir feasibility 
.as evaluation criteria. These outcomes ^ere rated by a smqfll sample of 
people familiar with program evaluation and vocational education as to their 
importance. and feasibility. These ratings are included in the study. 

The final section reports -the findings of a pilot test of one program 
evaluation outcome (reducing the risk of unemployment for minority youth) 
based on data from two states with large minoritynpopulatio'ns . While the author 
describes available data sources for outcome evaluation, the pilot test documented 
the problems associated with identifying data on minority youth with vocational 
training. The research indicates that data limitations may confront yjrcational 
evaluators regardless of the outcome measure utilized. 
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Davie, B. F. "Benefit/Cost Analyses of -Vocational Education: A Survey.' 
Occupational Educaticn--P1 anning and Programming. Volume Two . A. Kotz, 
Menlo :Park, CA: Stanford Research Institute, 1967. 



ed, 



General considerations in benefit-cost analysis of vocational education 
are pre$ent?d in this work. Included are detailed lists of the potential costs 
and benefits of vocational education and a discussion of three criteria for 
making benef i t-cosjt decisions: (*f) present value of net benefits, (2) rate .of 
return, and (3) benefit-cost ratio. Davie suggests that the benefit-cost ratio 
is superior to the other measures. He also discusses the merits of cost- 
effectiveness analysis and explains one potential use of this methodology. 

Davie nrakes the following general ^conclusions about cost-benefit analysis. 
He believes it is not sufficient in cost-benefit analyses to address the 
question,' "Should a program be continued or discontinued?" Rarther, one must, 
ask, "Should the Resources devoted to this program be diverted instead tJP^ 
a specific alternative (in order to produce a more useful result)?" Second, he 
contends that if the societal benefits associated witl* a particular vocational 
education program are significant but the monetary rewards to .individual 
participants are slight, stipends should be offered to encourage enrollment 
in vocational programs. 



w Davie also reviews three early cost-benef/i t analyses. 
( 1967), Corazzini (19^66), and Carroll* and Ihnen (1965). 



These are Eninger 
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Dorfman, r! (ed.). Measuring Benefits of Government Investments. Washington^ 
DC: . The Brookings Institution, J 965. 

This** collection provides evaluative papers on seven types of government 
projects. The authors of these papers are Gary Fromm, Herbert E. Klarman, 
Ruth P. Mack and Sumner Myers, Herbert Mohring, Jerome kothenberg, Frederic M. 
Scherer, and Burton A. Weisbrod. - Dorfman prefaces these articles with a ^ 
brief discussion of cost-benefit methodology. 

Of particular relevance is the article "Preventing High School Dropouts" 
by Weisbrod. Weisbrod utilizes cost-benefit analysis to evaluate a dropout 
prevention program. Aggregated data concerning income differentials between 
non-college bound high school graduates and high school dropouts are applied 
to a specific case study conducted in St. Louis, Illinois. Non-pecuniary 
components are incorporated into the analysis as biases, although no absolute 
monetary' val ue is assigned. Weisbrod concludes that in at least this case 
study, monetary costs far exceed benefits. This selection also includes an 
excellent discussion on discount rate measures, an insightful rebuttal by 
Herman P. filler, and Weisbrod's reply. 
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Hale, J. A., Starnes, P. M. and Mickler, W. A. T he Development and Testing of 
a Model for Determining the Costs of Vocational Education Programs and Courses 
(Final Report). Gainesville, FL: University o,f Florida, Institute for Educational 
Finance, 1977. ' • ' 



This study was designed to develop and field test an "added cost" model 
for calculating vocational program dbsts per full-time equivalent student. 
Hale emphasized the difficulty in cost determination because of discrepancies 
in data format. He noted, ' however, that the overall quality^of pupil and 
fiscal accounting data is improving. 



Program data, student accounting data, and fiscal accounting data were 
compiled to determine the added-cost relationship of vocational education pro- 
grams. Among the concljtfSTons were that: 

t ' Vocational courses should pay closer attention to Department of 

Labor Occupation codes and the Office of 'Education vocational course 
numbering scheme^ • ^ 

A "basic" program Needs to be commonly defined. 

Discrepancies in student accounting methods used by secondary and 
postsecondary institutions do not allow for interorganizational 
comparisons. 

Student contact hours is the best student accounting method. 

Better data bases for fiscal accounting seem to exist at the post- 
secondary level . 

Objects-of-expenditures provide the common basic structure for 
relating expenditures to courses and program areas. 

The study also includes a User Manual containing the data forms, user 
instructions, a course cost algorithm, sample data classifications, definitions* 
and their sources, and a suggested data processing coding structure. 
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Hu ; T. and Stromsdorfer, E. W. "Cost-Benefit Analysis of Vocational Education." 
Handbook of Vocational Education Evaluation . C. K. Tittle and L. Cohen, eds . 
Beverly Hills, CA: Sage Publications, Inc., 1979. 



Hu and Stromsdorfer present a concise-overview of the methodological and 
measurement difficulties in performing a cost-benefit analysis of vocational 
education in this work. The presentation is divided into separate discussions 
of the problems of measurement on the cost. side and the benefit side. ?*" 

\ v 

I f On the cost side these problems include the distinction between educational 

expenditure and educational cost, joint costs, current costs, and capital costs. 
The problems in benefit measurement that afe treated include wages versus 
earnings, noneconomic benefits, and transfer payments. 

The authors also discuss a number of empirical studies 'estimating the 
costs and benefits of vocational education'. They conclude that these studies 
have suffered from the inadequate availability of data and the inability to 
successful ly measure non-economic benefits and costs of vocational education. 
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Kaufman, J. J. Cost-Effectiveness Analysis as a Method for the Evaluation of 
Vocational and Technical Education , Washington, DC: Department of Health, 
Education, and Welfare, Office of Education, 1968. 



This paper discusses cost-benefit analysis in terms of: (1) logic and 
meaning, (2) some of the mi sconcepticns which prevail concerning this method 
of evaluation, (3) some of the problems and limitations of this method, and 
(4) the conclusions of one study which attempted to determine whether or not 
there is. a pay-off from an investment in vocational and technical education. 



In the discussion of the logic and meaning of cost-benefit analysis, the 
methodology is described as an attempt to ^tablish the equivalent of a system 
of market principles for various types of government activities. Kaufman 
makes the important point that one should not talk about education in terms 
of cost or needs alone. No cost can be justified without a reference to pay-off; 
and the satisfaction of any need cannot be justified without reference to cost. 
He continues that since decisions must be made as to the allocation of resources I 
among competing educational programs, cost-benefit analysis is an appropriate 
method for making these choices. It tends to force administrators to think 
through their objectives, to concentrate on costs, and to think in terms of 
alternatives. 

A number of what ^Kaufmanydescri bes as misconceptions about cost-ben'ef i t 
analysis are presented. These include statements such as (1) cost-benefit 
analysis is merely a subterfuge for seeking to conduct education on a "least- 
cost" basis; (2) since benefits are measured only in dollar terms, this is a 
form of crass materialism; (3) because cost-benefit analysis measures pecuniary 
benefits, program objectives with nonquantifiable results cannot be justified 
by cost-benefit study; (4) cost-benefit technique has not been fully developed 
and therefore should not be applied; and (5) cost-benefit analysis appears to 
ignore political considerations. 

Kaufman also discusses the meaning of and problems in educational evalua- 
tion. He writes that measurement is a necessary part of evaluation, but ^ 
evaluation requires both premeasurement and postmeasurement considerations. 
Before measurement commences, evaluation requires the formulation of a basic 
educational philosophy (and its attendarft goals) and the statement of specific , 
behavioral objectives to be measured. After measurement is completed, evalua- 
tion requires:, (1) the analysis 'of measure* quantities in terms of the 
attainment of objectives and progress toward goals; (2) an estimate of the 
value of existing programs- in determining this progress; and„(3) an estimate 
of the costs involved in conducting these programs. 

The two paths to greater acceptance of evaluation 'are: (1) to assure the 9 
school administrator that the evaluation is to be used to study the process 
of education within the school and to help him/her improve this process, 
and not for the purpose of making value judgments about the school; and 
(2) to follow up this assurnace by utilizing evaluation procedures which are 
aimed at collecting only those data relevant to the educational process. { 
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Kaufman includes a discussion of the findings of his Pennsylvania study 
as an example of cost-benefit research, -In the study he found that vocational 
technical graduates earned significantly more and were employed significantly 
longer than the graduates of the other curricula during a* six-year post- ( 
graduate period. It was asstfflfed that earnings and employment are appropriate 
indices of the benefits of education. 
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Kim, J. E. A Cost-Effectiyeness/Benefi t Analysis Model of Postsecondary Vocational 
Programs (Technical Report) . Bloomington, IN: Indiana University, Department 
of Vocational Education, 1977. 

This technical report, presents a cost-effectiveness/benefit analysis model 
fcJp post-secondary vocational programs which was developed for the Indiana State 
Board of Vocational and Technical Education. Kim defined cost-effectiveness/ 
benefit analysis as a technique for assessing the outputs-of existing and/or 
new programs in relation to their specified program target goals and against 
the associated costs. The specific project objectives were: (1) to conceptual- 
ize cost-effect^ veness/benefi t analysis; (2) to develop a conceptual model, data" 
forms, and a standard procedure for using this model; (3) to evaluate the model 
and data forms; and (4) toK produce- an administrator's manual. 

A tri-dimertsional structure was conceptualized fpr vocational program evalua- 
tion. The structure consisted of: (1) program classification by degree 
level; ,2) the criteria of effectiveness, efficiency and performance; and 
(3) a time frame for one-year completion, two-year graduation, and follow-up 
survey. 

A cost-effectiveness/benefit model was developed within the input-output 
framework. Social demand, support, and student characteristics were considered 
as inputs to the school system, and monetary and non-monetary benefits for 
society were viewed as long-term outcomes of the educational system. Four 
major components of the model were specified by: (1) program classification; 
(2) program objectives; (3) program outputs; and (4) program costs. 

The model was designed to generate three kinds of cost-effecti veness/benefi t 
-measures: (1) program effectiveness; (2) cost-efficiency; and (3) a cost-effective- 
ness and performance ratio. Fifteen formulas were presented to compute these 
measures. Target goal statements were developed to include fi ve 'objectives : 
(1) enrollment; (2) career preparation; (3) placement and. employment; (4) 
advanced studies; and (5) economic M5enef i ts . The two data forms developed in 
accordance with the program objectives were: (1) a data form designed to 
determine program goals and outputs pertaining to enrollment, career preparation, 
job placement, advanced studies, and long-term benefits; and (2) a simplified 
data form for analyzing and computing direct and indirect program costs. 
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Kim, J. E. and Harris, R. C. A Cost-Effectiveness Analysis Model' for Secondary 
ocational Programs (technical Report). Bloomington , IN: Indiana University, 



w 



Cecartr.eot or Vocational Education, 1976. 

» 

\7his paper presents a conceptual model to analyze the cost-effectiveness 
of secondary vocational programs focusing upon program effectiveness, cost 
efficiency, and management performance. The model consists of four components: 
vocational program classification; program objectives; program outputs; and 
program coUs. It generates three kinds of cost-effectiveness measures: 
^program effectiveness, cost efficiency, and cost-effectiveness and/or performance 
ratio. The authors identify eight elements for analysis and base the model upon 
these elements. They also distinguish cost-benefit analysis from the cost- 
effectiveness concept., 

r 
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Levin, H. M. "Cost-£ffectiveness'Analysis in Evaluation Research. " . Handbook 
of Evaluation Research . M. Guttentag and E. L. Struening, eds. Beverly 
Hills, CA: Sage Publications, 1975. 

This paper discusses cost-effectiveness analysis in evaluation research 
*«d -focuses upon its application to social programs and policies. The author 
presents a rationale for utilising cost-effectiveness methodologies and 
compares them to cost-benefit and cost-utility analyses. He then discusses the 
cost-eff§cti veness technique in detail examining both its conceptual nature 
and the methodology of assessing the costs of alternatives and of measuring 
effectiveness. Levin cites a number of studies that used either cost-benefit 
or cost-effecti vene'ss techniques. 1 

He concludes that the cost-effectiveness technique is a potent source of 
information. However, its results need to be combined with "other factors in 
order to make rational policy decisions. ' - 
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Mortrenweiser, G. , et al . Planning Design for Conducting a Natz'ional Survey of 
the- Differential Cost of 'Vocational Education . Minnea-pol is , MN: Educational 
Management Services, Inc.,' 1979. 

The" objectives for this project were (1) to desjgn a rational survey 
utilizing the Institute of Educational Finance differential cost model of 
costing secondary and postsecor^dary vocational ,educatio.nal programs, and (2) 
to modify the model to. allow foA separation of the costs associated jrfith ^ * 

^..Va + ins. fko hsnrliVannorl frnm hs<;-tr education COStS. The DrO.TeC" J " ^ " 



educating the handicapped from basic education costs. The projTct'determyied 
in a field test that the model adequately calr 
vocational education at the subprogram level. 




National Institute of Education. The Vocational Education Study: The Interim 
Report Washington, DC: U.S. Government Printing Office 1 , 1980. > 



This report discusses the effects of the changes in Federal vocational 
education legislation adopted in 1976 upon the distribution of Federal funds 
and the planning and evaluation of vocational education ^programs by^the 
states. It also describes the results of research on the effects of par- 
ticipating in vocational education programs and surveys selected features of 
public school vocational education. .In addition, the report examines the 
various effects of vocational education upon program participants. All of 
these issues are themes in this ongoing research effort that was mandated by 
-the Educatioh Amendments of 1976 (P.L. 94-482). 



1 r 



\ 



7 



51 



3-35 



r 



Prest, A. R. and Turvey, R. "Cost-Benefit Analysis: A Survey." The. Ecdnomi c 
Journal 75 (December 1965): 683-735. 

Prest and Turvey define cost : benefit analysis as a "technique for determining 
which public investment projects will have the greatest net benefits for 
society as a whole. This article- provides a discussion of the general principles 
of the methodology followed by examples of how cost-benefit analysis could be 
applied to the evaluation of several types of public investment projects. The 
application of cost-benefit analysis to evaluate public education is one of 
the examples used. 

Prest and Turvey equate the benefits of a particular project to what 
people would be willing to pay for them if an effective market for the ctods 
or services existed. Costs are equal to the present value of consumption fore- 
gone in order tj finance the project. Translating this theory into practice, 
however, is problematic. For example, calculating the present value of con- 
sumption foregone in order to finance the project is sometimes complicated by 
the fact that what is foregone may not be just present consumption. If the 
project in question would take funds a\/ay f#om other investment projects which 
would have provided other goods and services in the future, then the present 
value of those goods and services represents a part of the cost of undertaking 
the public investment project. 

PresKa»4 Turvey correctly'.assert that cost-benefit analysis may be of 
limited use foV evaluating projects that are national in impact since these 
projects 'are likely to alter the universe; of prices. Costs and benefits are 
calculated assuming that prices remain constant. If the project being studied 
causes prices to change, conclusions about its net benefits could be misleading. 

Problems in measuring the benefits of investment in education are also 
discussed in this review". Increased income is a positive benefit to society 
to the extent that it represents an increase in productivity. However, Prest 
and Turvey" question the actual correlation of earnings and marginal productivity 
(or marginal value to society). Also., they note the problem of using cross- 
sectional data to predict income into the future. However, Prest and Turvey 
suggest that even though cost-benefit anaWsis of public projects involves 
making subjective estimates of the dollar\lue of the* project ' s benefits, 
especially for non-pecuniary benefits, such an analyses is superior to solely 
relying on vague qualitative judgments of a project's worth. - 
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Reinhart, B. and Blomgren, H. Cost Benefit Analysi s--Trade and Technical 
Education (Final Report). Los Angeles, CA~: University of California^ 
Division of Vocational Education, 1969. 



This report contains introductory material on cost-benefit analysis, a 
review of two cost-benefi t*studies of vocational education, and a* discussion 
of two basic approaches to cost-benefit analysis of vocatiopal education. A 
proposal for a cost-benefit study oTMiigh school ana junior co Liege vocational 
education follows the general text. Among the theoretical components* of^ost- * 
benefi t analysis discussed are joint costs (when a vocational program j^rares 
facilities with an academic program, the authors, conclude that it is not 
necessary to sort out how "much of the value of that facility should count as 
a vocational education cost), acid capital costs (the authors include a formula 
which explains how to count the cost of capital equipment which will outlast 
the program being studied). 

Reinhart and Blomgren write that there are two broad categories of cost- 
benefit studies in vocational education: (1) vocational versus academic 
education, and (2) vocational versus vocational education. Most analyses of 
vocational education have so far been of the first type. In thfs approach it 
/ is assumed that vocational and academic education are di fferent'means of 
achieving the .same ends. This erroneous assumption may cause misleading 
results. It *is proposed that studies of the second type be conducted instead 
in which the levels of cost-effectiveness of various vocational education 
programs may be compared. 
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Rothenberg, J.' "Cost-Benefit Analysis : A Methodological Exposition." 
Handbook of Evaluation Research . M. Guttentag and E.'L. Struemng, eds. 
Beverly Hills, CA: .. Sage Publications, 1975. 

This paper examines the methodological considerations in cost-benefit 
analysis. The author also presents applications of cost-benefit designs to 
suggest the scope of issues encountered. 

Included in the discussion are such issues as the structure of social 
evaluation; the structure and scope of cost-benefit analysis in terms of ends, 
means, a-nd scarcity, individual, group, and social evaluation; the value 
context of cost-benefit analysis; the meanings and benefits of costs, income level, 
and income distribution; issues in measuring benefits and costs; and examples of 
appl ications . 

» 

Rothenberg concludes that cost-benefit analysis is an attractive method 
for certain situations. However, he also raises concerns about its practical 
usefulness when there is a serious inadequacy of relevant data. < 
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Smith, R. E., "The Opportunity Cost of Participating in a Training Progra/n." 
Journal V Human Resources 6 (Fat 1 ! 1971): 5'10-,519. 



This paper presents an analytical model to estimate the foregone income of 
students in a manpower training program. The model is applied to institutional 
training under the Manpower Development and Training Act (MpTA). 

^ The author believes that estimating foregone earning</of. trainees is the 
weakest component of most economic <analys>* of manpower programs, yet none of 
the methodological studies reported in t the 1 i terature f have focused specifically 
on this problem. The 'assumption implicit in most studies is that current employ- 
ment status is an unbiased^estimate of subsequent status. Smith contends 
that this is valid only if entrance into the program is unrelated to economic 
status, an assumption that is not likely to be true. 

To estimate the proportion of the trainee group that would have bfeen 
employed in each of the months of training (or the probability that % any particular 
trainee would have been employed), the author assumes the condition % of a fi*!st- 
order Markov chain process. 

5 To estimate the trainees' foregone e^nings, Smith e .calculates their 
likelihood of being employeed, given their demographic characteristics, education, 
labor market handicaps, and the overall level of unemployment in the region. 
Using a Markov process, each trainees' likelihood of employment is in this way 
estimated for c eacjn month of the training program. These employment rates are 
combined with a rough estimate of the average rate of the appropriate comparison, 
groups * to compute an estimate of total foregone earnings. 

In an application of the model on a select group of MOTA institutional-** 
trainees, the average foregone earnings was estimated at $1,280, considerably 
greater than generally assumed. ^ Smith discusses two policy issues that were 
raised by his findings. First, 'to the extent' that the earnings loss is not, 
offset by gains of npft--h*ainees , the immediate loss to the economy is greater 
than asserted^ in mosfc evaluations, suggesting a lower belief it-cost: or effective- 
ness-cost ratio for /the training programs. Second, the redistributional impact 
of manpower programs may not conform with the intent of the legislation. 

Beginning in fiscal 1967, one explicit objective of MDTA training has been 
to aid the competi ti'vely disadvantaged in the labor market. The estimates 
Of the foregone earnings of trainees made by the study suggest that, in the 
short run, the trainees themselves are bearing a large portion of the training 
co£ts, even after receipt of training stipends. If the trainees are persons 
to whom sqciety wistfes to transfer purchasing power in the current period an<^ 
increase the expected value of their 'future earnings, the. training stipends or 
other transfers would need to at least -balance their immediate earnings tosses. 
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Stromsdorfer, E. W. "Economic Concepts and Criteria for Investment ia Vocational 
Education. " Occupational Educations-Planning and Programming. Volume Tw o. 
\otz, ea. >ienio Park, CA: Stanfora Research Institute, 1967. sr 

\ a 

Stromsdorfer reviews various techniques in, and components of, cost- * 
Denefit analysis of vocational education. He includes a particularly interesting 
discussion of the potential problem of double-countvtig educational benefits^ 
By way of example, Stromsdorfer explains that the counting of certain intangible 
benefits of vocational edupation, such as increased mobility or labor force 
discipline, may be redundant if' they are already reflected in increased earnings. 
Similarly, to consider the extra income tax revenue generated by vocational 
graduates would be fouble-counting since this revenue comes from their gross 
earnings which already is probably included in the cost-benefit model. Reduc- * 
tion in welfare benefits is not "calculated as a net benefit to society since 
it merely transfers funds from one group to another. 

Stromsdorfer also makes the following conclusions: 



It is possible that rather than reducing aggregate unemployment, 
vocational -education actually displaces untrained workers with 
those who have received vocational training. This displacement 
would have to be figured into the costs of vocational education. 

Spending public money on vocational education may constitute an 
indirect subsidy to industry. Since it expands the supply of skilled 
'labor, vocational education allows firms to pay wages that arejower 
than they would otherwise have to pay, thereby increasing profits 



He also discusses the % trade-offs between the present value of net benefits 
and internal rate of return criteria and circumstances under which any cost- 
benefit criteria may be inappropriate. * 



and/or reducing output prices. 
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COST-BENEFIT APPLICATIONS 
IN VOCATIONAL EDUCATION 




Carroll, A. 8. and Ihnen, L. A. Costs and Returns of Technical Education : A 
Pilot Study . Raleigh, NC: North Carol ina 'State University, lybb. 



In this paper, Carroll ^and Ihnen present a relatively comprehensive analysis 
of the costs and benefits resulting from two^years of postsecondary schooling. 
The study is based on information concerning 45 graduates of Gaston Technical 
Institute, North Carolina, and their high school peers of similar academic 
performance who did not continue formal education after high school. 

Incomes of individuals may be affected by niany factors other than formal 
schooling. Carroll an*d Ihnen employed regression analysis to determine the 
portion of observed earnings differential that was attributable to^technical 
training. Individual earnings per month was regressed on a dummy variable for 
technical schooling, high school grade average, age-experience, mother's educa- 
tion, residence during high school, military experience, migration from home 
community, size of high school class, and two trend variables. All the 
coefficients were significant. Technical schooling was estimated to increase 
earnings by S38.98 per month. 

Cost estimates consisted of: (1) costs for books and student supplies; 
(2) school facilities, supplies, and personnel; and (3) loss of production by 
students while enrolled in school. In probably the weakest methodological -step 
of the paper, estimates of future earnings' di fferentials were based on differ- 
ences exhibited in cross-sectional data of individuals wh^ had completed only 
high school and those with one to three years of college experience. The 
report also attempted to estimate a partial evaluation of^tfte additional fringe 
benefits typically enjoyed by , individual s with technical educations. 

In this report, Carroll and Ihnen reconcile the costs and benefits of 
technical schooling by both the rate of return and discounted present value 
methods. Private and social rates of return are evaluated. The report 
also includes a discussion of appropriate discount rates. Carroll and Ihnen 
concluded by asserting that high r.ates of return exist for investment in post- 
secondary technical schooling. 
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Conroy, W. G. Jr. and Diamond, 0. E. The Impact of Secondary School Occupational 
Education in Massachusetts , Lowell, MAl The University of Lowell, 1975. " 

This is' a study of the impact of vocational education on workers' earnings 
, in Massachusetts. A random sample of 2,600 vocational -technical and general 
' academic program graduates was the subject, of study. The authors .found that 
male vocational school graduates had an average annual salary that was $1,378 
higher and found jobs an average of four months sooner than male general aca- 
demic program graduates. Female vocational program graduates did not generally 
earn more than female general academic graduates. 

The authors also make various conclusions about the characteristics of 
Massachusetts' vocational population. Vocational school students were of lower 
socioeconomic status, scored lower on scholastic aptitude measures, evaluated 
high school as a more positive experience, and received more help from their 
schools in finding jobs than did academic students. 




Corazzini, A. J. Vocational Education:^ A Study of Benefits and Costs 
Princeton, NJ: Princeton University, 1966. 
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Corazzini's study i^fme of the earliest cost-tenefit analyses in vocational 
education, Its findings question the efficiency of investment fn vocational 
education. This report summarizes a study of the costs and benefits .of public 
vocational education in Worcester, Massachusetts. Differences between regular 
and vocational education were calculated with respect to'their public direct 
costs (current account items such as teacher salaries), public implicit costs 
(such as what the city would earn if it rente'd out the school building and 
equipment) ," -and direct private costs (costs incurred by students for books 
and supplies). -Measurement of the cost differential between regular and 
vocational education was simplified since Worcester has separate institutions*^ 
for these two types of education/- * 

la a series 'of sub-studies, Corazzini also examined the ^mpact of vocational 
education on student benefits measured as an increase in lifetime earnings, in- 
crease in intergenerational mobility, and increase in geographic mobility. In 
one sub-study, the starting, wages of high school graduates in selected locaj 
firms were compared. The differential between the wages of graduates from 
regular high school programs and. those of graduates from vocational high school 
programs was determined. Corazzini then calculated the number- of years this 
wage differential must be maintained in order for vocational education to 
justify its extra costs. He found that after a few years of experience, 
workers' wages do not generally depenc| on whether they attended regular or 
vocational high schools. Assuming that the vocational high^school graduates 
at these firms would have gone, to a recftllar high school had'the vocational 
program been unavailable, Coraiz'ini concludes that by this measure the costs 
exceed the benefits. ■ a 

Another sub-study examines the benefits of vocational education .under the 
assumption that its availability prevents some students from dropping out of 
school. By this measure, the benefit of vocational education is the difference 
between *the lifetime expected 'income of a vocational high school graduate and 
that of a dropout. Corazzini concludes that if every vocational high school 
graduate would have dropped-owt had vocational education been unavailable, 
then the benefits of these vocational programs exceeded their costs. However, 
the impact of vocational education on dropout rates is not known. 

i 

Another sub-study followed the employment history of graduates from a 
girls vocational high school for 18 months after graduation. Research ^showed 
that their wages were very close to the Federal minimum^wage. No attempt was 
made to determvfie whether graduates from this program were more successful in 
finding jobs than women who had graduated from the regular high school. 

The benefit of intergenerational mobility was studied' by comparing the 
type of job of vocational program graduates to those of their fathers. Over 
fifty- three percent of the* vocational program graduates were white collar"' 
workers, but only 17.4 percent of the fathers wereNn this category. Corazzini 
concluded from this limited data that vocational education is probably res : 
ponsible for enhancing intergenerational mobility, ne also suggested that on 
the basis of where vocational program graduates accepted jobs, there*was no 
evidence that vocational education had enhanced their levels of geographic 
mobility. 
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Doty; C. R. , et al . . Model for Calculating Cost per Pupil for Secondary Voca- 
tional, General, and Transfer Curricula in Comprehensive High Schools, Shared 
Time Vocational Schools (Final Report). New Brunswick, NJ : Rutgers University, 
Department of Vocational -Technical Education., 1976. 

> 

This study neports the findings of a two-Uage investigation into the cost' 
of education programs. The objectives of the first stage of the study were 
to review the literature, to identify and define financial cost variables ,' to 
develop, test, and revise a daia collection model, and to report the findings. 

The second stage invol-ved refining the model; developing^guidel ines »for 
local administrators to use the model; applying the model in a comprehensive 
high school, a full -time vocational school, and a shared time vocational school; 
and identifying the cost ratio among vocational, college preparatory, and 
general education programs. 

A stratified random sample was utilized and data collected from four public 
schools in New Jersey. The authors conclude that the model developed can 
provide accurate costs per pupil per program or educational goal, although there 
are some limitations on its appl icabil i ty ' to all types of schools. # 
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'Eni^ger, M. U. Effectiveness Evaluation Data for Major; City Secondary Education 
S./s ferns in the U.S7 Pittsburgh, PA: Educational Systems Research Institute, 

1972: 

This article discusses the Manpower Conversionf Equation* which is a*theoreti- 
cal mo'del designed to enable vocational education administrators to manage 
manpower development systems and to apply management tools to vocational 
education programs. The model, states that supply should equal demand for 
^skilled manpower. From this model, six vocational education objectives were 
generated by Eninger. Questionnaires were given to a sample of graduates from 
449 secondary schools in 22 cities and analyzed-by sex and race, type of program, 
and type of occupation. Ten problem §reas were identified -in the analysis: 
absence of the manpower conversion concept, absence of measurable vocational 
education objectives, inadequate vocational education supporting systems, undefined 
responsibility and accountability, inappropriate administrative organization 
for e^fecYi ve vocational education, inadequate relations with the employer 
community, inadequate relations with the community of parents , 'absence of 
vocational education operational research, inadequate involvement of vocational 
teacher personnel, and inadequate application of management concepts, principles,, 
and techniques* 
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Sallowav, L. E. and Ghazalah, I. A. The Role of Vocational Education in Improving 
Skills and Earnioq Capacity in the State of Ohio: A Cost-Benef it .Study . Athens, 
OH: Ohio University, College of Business Administration, 1972. 



The authors report the methods and findings of a benefit-cost analysis 
of 14 subject areas of vocational education in 18 high schools. Both private 
and social rates of return were calculated for each subject at each high school. 
The study employed two different comparison groups, high school dropouts and 
stuxlents^enrol led in non-vocational programi. 

The study utilized both monetary and nonmonetary benefits. Monetary 
benefits were calculated as earnings. The non-monetary measures included job 
satisfaction, work attitude, communication skills, interpersonal relationships, 
and self-confidence. For most programs, /the authors found favorable rates of 
return and recommended continued investment in secondary vocational education. 
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ra.roy, u., narper, R. ,ana Myers, l. A Comparison Study of* the Benefits of 
Secondary ana Postsecondary Vocational Education . Portland, OR: Northwest t / 
Regional Education Laboratory, 1978. 

This study examined the returns on investment of secondary and^ostsecondary - 
m vocational training curricula in Montana. The research is notable fo.r its 
use of non-pecuniary educational begefits. 

Tjie population studied was 85 v 7 high school graduates of the classes of 
197,0 *nd 1971 who were between 23 and 25 years old at the time of the survey ' 
and who had been employed for at least two years since their graduation. Data 
were collected through telephone interviews employer surveys, and mailout 
surveys. The focuses of the data collection were on thV-graduates 1 perceptions 
of their training, employers' perception of the training, and comparison of 
graduates' perceptions of quality of life. The population was divided into 
three groups based upon their training: (1) postsecondary vocational, (2) 
secondary vocational, and (3) acacjemic/general . 

i 

Among the results, the authors found that postsecondary vocational, gradu- 
ates were more satisfied with their training and had attitudes employers seek 
in their employees, but had a tendency toward feelings .of depression. Not 
surprisingly, academic/general graduates had high esteem for academic educa-r 
'tional programs, while postsecondary and secondary vocational students had 
low esteem for these programs. - 4 
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Harris, M. A. Benefit-Cost Comparison of Vocational Education Programs : 
Statewide Evaluation of Vocational -Technical Education in Florida . 
Tallahassee, FL: Florida State University, 1972. 

This study was concerned with statewide benefits and costs' of vocational • 
education programs in Florida. The purposes of this study were fourfold: 

• Develop a methodology for* conducting a statewide benefit-cost 
study of vocational education programs in Florida. 

• , Examine, compare, and analyze the 'public and private benefit and „ 
' cost aspects of four vocation^education^ programs in Florida. 

• Comoare the public and private benefit and cost aspects of students 
who attend vocational education programs while enrolled in day high 
school and students not enrolled in day high school. 

• Procjce formulas which result in the development of a *:del for 
predicting public and private -economic returns of Voce 1:0 lal 
education programs. 

The study included measures of both public and private vocational education costs 
and pecuniary and ftto-pecuniary benefits. Among the measures of non-pecuniary 
benefits were whether former vocational education students were employed and 
the degree to which students were employed in occupations related to their 
vocational education proqrams. / 

To account for the influence of regional price variations and regional 
labor market conditions and wage rates, the analysis divided the state intn 
major geographic ceqions. Within each reqion, two institutions designated 
as areSvvocational centers were randomly selected. Based -upon stated criteria, 
four vocational education programs were included in the study. 

The differences between the net wage rates for skilled workers and' the net 
wage-rates for unskilled workers represented the net economic benefits resulting 
from vocational education programs. The annual benefits before Federal income 
tax deductions were considered publ ic Taconorcic benefits since these earninqs 
represented an increase in national income. Annual benefits after Federal 
income tax seductions were considered private economic benefits s'ince 
these earnings represent an increase in personal disposable income. Srnce the 
relevance of the vocational training .to employment skill requirements did not 
enter into the. calculation of monetary benefits", a relatedness index was 
developed as a third measure of benefits. 

In order to calculate the public cost, of vocational education 
'two factors were considered:- (1) the quantity of time 'students spent ina$ 
vocational education program (hours. Of attendance); and (2) the value- oncost 
per unit of time of the services received by individual students. The sTudy 
included aa analysis of nine categories of expenditures to obtain the dollar 
cost per full-time-equivalent student for each course. 

Private indirect costs were measured as a function of two factors: (1) 
the' quantity of time that .a student spent in a given vocational education 
program; and (2) the valu£ or pric^of time measured by earninqs foregone. 
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Private direct costs used in the "aria lysis ' incl uded tuition, books, supplies, 
uniforms, special equipment, and transportation'. 



Linear equation mode 1 
education were developed. 



s for projecting returns on investre r t n n vocational 
The findings , included: 



Rates of return vVom investment in 
vocational education programs were 



each of the four selected 
positive and significant. 



These findings suggest that promotion and expansion of vocational 
education in Florida would be a wise economic investment. & 

There were statistically significant differences in the rates of 
return on investment between different vocational programs. Harris 
believes varying rates of return are a justification for reallocation 
of resources among programs. „ -* 

There were statistically significant differences in rates of return 
on investment between secondary and" postsecondary vocational 
education. * • 

/ 

On the average, student costs of vocational education are greater H 
than publ ic 'costs . >In order to provide students with information 
necessary for allQ^^Jtuig their resources , -i t is suggested that . 
summaries of stucTies such as this be provided to "students\and _ 
guidance counselors. ^ . . 
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Hu , T . Studies of the Cost-Efficiency and Cost-Effectiveness of Vocational 
Education" ! ColumbuST OFT Ohio State University, National Center for ~~~ 
Research in Vocational Education , 1980. 



Hu summarizes the'uiajor concepts in cost : ef ficiency and cost-effectiveness 
analysis and reviews the major findings of past research in these areas. He 
( defines cost-efficiency studies as those involved with determining the optimal 
* distribution of inputs in order to minimize costs. Cost-effectiveness analysis, 
# which is used interchangeably with cost-benefit analysis, examines the relation- 
ship between program costs and outcomes. 

& 

Among the technical concepts briefly presented are expenditures versus 
costs, average versus marginal costs, joint costs, ^opportunity costs, wages 
versus earnings, non-economic benefits, discount rates, and .transfer payments. 
However, the major contribution of this paper is the review of existing cost- 
efficiency and cost-effectiveness analyses, primarily those performed after 
1970. 
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Hu, T., Lee, M. L., Stromsdarfer, E. W.^and Kaufman, J. J. A Cost-Effectiveness 
Study erf Vocational Education . University Park, PA: Pennsylvnia State 
Jn i ;eri sty , Institute fo£ Research on Human Resources, 1969. 

"n-s study compares the costs of vocational and comprehensive secondary 
ecucation, anaVthe labor market performances of graduates of the^e schools 
no did not atrtread college. Measures of labor market performances are average * 
monthly before-tax earnings for a six-year period following graduation and 
the percent of time employed durintj that same period. Earnings before taxe£ 
are considered^ social benefit since the incremental increase in before-tax 
earnings whicfy/are due to the inve^ient in ^ocatjjonal or comprehensive 
education represents an explicit nreasure of the monetary returns to society, 

Data were obtained from the responses, of 2,767 mail questionnaires sdnt^V 
in 1966 and 1967 to graduates of high schools in Philadelphia", Detroit, arjd . 
Baltimore. Multiple regression analysis was used to measure the net effect 
of curriculum on the labor market performances for the two types of graduates 
wnile S^ntrolling for the effects of confounding variables such as socioeconomic 
characteristics'. - * 

In comparing the costs and returns of the, two types of high School education, 
a cost analysis was first performed using the capital* recovery factor. The 
authors • assumed an average building' life was 60 years and'used social discount 
rates of.six and ten percent. 'The total {capital and current) costs were related 
to' average daily attendance (ADA). "The difference in opportunity costs among 
vocational and comprehensive graduates while they were attending high school 
was assumed to be negligible. 

Monetary returns for high school graduates were obtained through a regression 
nalysis. Net present value, benefit-cost ratio, and rate of return were cal- 
ul ated for vocational and comprehensive education stud^nts. * % ' 

The authors concluded that amqr^g students who do not attend college, the 
monetary returns of vocational gracDiSrtes are higher than those of comprehensive 
high school graduates. The authors noted, however, that it is necessary to 
estimate earnings and employment equations separately on the basis of sex and 
race to obtain accurate distinctions. Also, the earnings differential may be 
disappearing as these graduates move along with lifetime earnings profiles. 
Nevertheless, investment in vocational education is economically efficients 
if money cost£ and benefits are relatively complete indexes of total economic 
costs and benefits. Finally, the authors no tie that the study ignores all 
non-ecpnomic costs and benefits of the two types of secondary education, * 
although it is recognized that these non-economic factors are important in 
any analysis of the total impact of education. j+ 
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Ittner, F. E. Project to Develop a Cost-Benefit Mode? for Vocational Programs 



at ColJege of 'Alamed a (Final Report ) . Los Angeles, 
Clearinghouse" for Junior College Information, 1 972. 



CA: University of California, 




This. report describes a pilot Study on the development of a xost-benefi t 
model for vocational -education programs at the postsecondary level. The model 
was applied .to three vocational programs at the College of Alameda, -California - 
Business Equipment Technology, Dental Assisting, and Diesel Mechanics. Data 
were gathered through a survey of the five graduating classes from 1968-1972. 

A^e^ible model was designed so that it may be used to compare tfte rela- 
tive'effectiveness between programs within the same college or atjjifferent 
colleges. Costs were broken down by direct and indirect, categories . Included 
in the cost calculation was the cost of classroom space and depreciation of 
equipment. Benefits were assumed to be the increased earnings of the voca- 
tional graduate as compared wfth his/her earnings before the schooling, or 
witn the average earnings of his/her cohorts in the area served. These costs 
and benefits were categorized for the student, institution, and community. 

•An increase in income was calculated for the vocational graduates. However, th 
increase was quite small. The report points out however, that over a longer^ 
period of time graduate earnings may increase sharply. Ittner suggests ^ th^tf a 
careful analysis of the 'initial wages* %lus # the wages earned after a period of 
time, turnover of jobs, and job satisfaction should be^an important part of^ 
future analyses of the ef fecti veness *of vocational programs. * , 
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Kaufman, J. and Lewis M. The Potential of Vocational Education: Observations 
and Conclusions . University Park, PA: The Pennsylvania State University, 
Institute for Research or Human Resources, 1968. 



This report is a general discussion of vocational education through data 
obtained in studies of three cities in Pennsylvania. It focises upon the 
extent of vocational programs in schools, the modification of these programs 
to meet student and employer needs, and the overall, strengths and weaknesses 
of the programs. The study also obtained information Qn the Vocational education 
graduate's evaluation of his/her training and experience in employment and . 
raises the question .of whether the extra costs of these programs produce 
sufficient benefits to maintain t^ie programs. Data were collected from school 
records, census data, and supervisors' evaluations of graduates' job performance. 
The authors conclude tnat students need a more thorough orientation to vocational 
training than they currently receive in order to benefit from the vocational 
progran and career opiions available. 
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MKh, J. V. A Benefit-Cost Analysis of Vocational-Occupational Training at 
Selected Illinois Junior Colleges , Springfield, IL: Illinois State Advisory 
Qouncil on Vocational Education, 1972. 



This report' presents the findings of a cost-bemefit analysis o.f vocational . 
training at the junior college level in Illinois. UtiTizing cross-sectional { 
survey data collected from graduates of five junior colleges, Koch estimated ' 
that the private rate of return to the vocational student of technical .train- 
ing was 12.3 percent and the social rate of return was 8.9 percent. 

Koch begins the report with a .very brief overview of literature in the 
vocational evaluation field. Three studies are specifically reviewed: Hardin, 
\oscow, and 3orus (1971), Gubins (1972), and Carroll and Ihnen (1966). 

<ocn tnen introduces eight issues which neec be considered wnen performing a 
::s:-Denefi ^analysis. He comments that: (1) vocational-occupational trai-ning 
gradates wouija hav>e -earned certain incomes even if they had not obtained a 
degree; (2) a large proportion of the observed income differential between 
vocational training graduates and high school graduates may not be due to 
increased education but rather to greater motivation and ability; (3) individuals 
enter and leave the labor force periodically and therefore do not earn the 
income which is reported for their peers in some yearx (4) some education and 
training is viewed by students as being a consumption expenditure rather than 
an investment expenditure; (5) large intergenerational effects and externali- ^ 
ties may. be caused by education and training which 3re not captuced -by income 
data; (6) increased incomes are -v u l nerabl e to increased tax payments; (7) many 
jobs have non-monetary aspects such as vacation time, insurance, and other 
benefits; and (8) cross-sectional data may result in misleading results. In light 
of these considerations, Koch modified (in a not entirely satisfactory manner) the 
typical rate of return formula. 

* Three types* of cost were calculated and* summed in the analysif to produce 
a total cost- value. These ca$t components were:. (1) direct costs paid by 
students; (2J direct ^costs paid by society (e.g. faculty salaries, equipment, 
etc*); and (3) income foregone by the students. Benefits were calculated as 
the difference between the income of the vocational graduate and the median 
"income of non-vocational high school graduates. This value was then reduced 
by 25 percent to reflect differences in ability and motivation. Utilizing 
this methodology, Koch arrived at his estimated rates of return.^ The rate of 
return is greater for the vocational student than society as a wfiole because 
the direct costs of school incurred by society are not considered in the i 
calculation of the vocationa.1 graduate's rate of return. 
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Marson, A. A., Weiner, A. E. and Sorenson, R. P. Cost-Benefit Model Development . 
Cost-Benefit Study (Final Report). Fond du Lac, WI: Lakeshore Technical „ 
Insitute and Moraine Park, Technical Insitute, 1978. ^ 



This .report details the findings of a three year study .by the research- 
departments at Moraine Park and Lakeshore Technical Institutes. The major 
emphasis of the report was to examine the non-monetary benefits of a vocational- 
technical adult education (VTAE) program. 

Five vocational training programs were examined. School records were 
reviewed to obtain the cost of offering each program. Two similar survey forms 
were 'developed and sent- to" VTAE graduates from these five programs and a 
sample of academic high school graduates. Data from these two sources were 
analyzed to compare costs and benefits. 

Costs and benefits were related by calculating the net present value, 
the benefit-cost ratio, the average rate of return* and the duration of the 
payback period. These calculations were performed for both the student and . 
society as a whole. 

The following conclusions were reached as a result of the analys-is: 

• From an economic viewpoint, the benefits of a vocational -technical 
education to society and to the students themselves are greater 
than the costs of offering the education to the student. 

• VTAE students score higher on tests of study habits and attitudes - 
than°do high school students. 



• There is a correlation between attitudes (study habits) and program 
success. 

% Both high school graduates as well as VTAE graduates have positive » 
attitudes toward education and toward employment as well as 
positive degrees of sel f Acceptance. Little evidence exists to show 
that a vocational-technical education per se has any effect on these * 
three attitudes . 

• Vocational-technical school graduates receive much more help from 
their school in finding a job than 4o high school graduates. 

• More VTAE graduates are employed in a position they consider 
permanent within two yea/s after their graduation than are high 
school graduates. 

• Vocational-technical graduates 'enjoy more job satisfaction than do 
high school graduates. \ 

\ . : 

• A vocational-technical education does affect the student's personal 

as well as^fanjily life. However, two-th'irds of the graduates surveyed 
stated that they weren't greatly hampered in spending time'with family 
and friends. 
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A vocational-technical education has little effect in motivating 
y students to become involved in social and/or community organizations. 
They seem to participate in such organizations to the* same degree 
'as the general public. 

VTAE graduatew-ecei ve more promotions on the average than da-high' 
school students entering directly into the labor market. 

High school graduates find a job faster following their graduation 
than do VTAE graduates. 

There are several personality traits and/or abilities which a greater 
percentage of VTAE graduates feel,, they have than do high school 
graduates. They include: academic ability, drive to* achieve, 
idealism, mechanical ability, and resourcefulness. 

ft 

Vocational, technical, and adult institutes do a good job in the 
placement of graduates. However, in the present study and in many 
related studies VTAE graduates are continuing their education 
either at another vocational school or at the college level. They 
feel that more can and should be done for students like themselves 
who plan to continue their education rather than look for a job. 
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Mertens, D. M. , McElwain, D. Garcia v G. and Whitmore, M. The Effects of 
Participating m ,'ocational Education: Summary of Studies Rkgorted Since 
1963. Col^Dus, OH: Ohio State University, Natrona! Center for Research 
.'ocaronal Eaucation, 1980. 

^ni 5 report summarizes 2 32 studies on the effects p^ r i :ipating in 
.cca clonal education in orce/ to determine whether there are consistent findings 
across studies for certain /elected variables. Seventeen variables were used 
and the studies were linn tea to the years 1968 to 1979. Postsecondary and 
secondary programs were reviewed separately. 

Jhe -findings focus on the relationship between- education and employment, 
"They include: no difference was found in uneniployment rates for vocational and 
non-vocational secondary graduates, al thougjn postsecondary vocational graduates 
had lower unemployment rates; a, majority of all vocational graduates find jobs 
in training-related areas. Other findings relate to earnings, basic skill 
attainment and academic abilities, further education, and level of satisfaction 
with t.raining. 
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Sparks, D. A Synthesis of Research Findings Which' Describe Selected Benefits 
and Outcomes for Participants in Vocatidna.l Education . Washington, DC: 
Office of Education, Bureau of Occupational v and Adult Education, 1977. 



U.S. 



This study identifies and explores ttfe benefits of vocational education. 
It examines the experiences of vocational graduates in an -effort to clarify 
how well vocational -.training serves its participants. 

The methodology employed includes a literature search using post-1970 ERIC 
indices, an examination of evaluation studies housed at the Bureau of Occupa- 
tional and Adult-Education, and contacts with persons familiar with vocational 
research. 

The studies show that vocational graduates generally do as well as, or 
bette" than, graduates of other curricula. Furthermore, vocational programs 
serve students from a lower socioeconomic background, a population that in 
general receives fewer benefits from academic or general education. Finally, 
in examining benefits, the author questions why vocational programs must con- 
stantly justify themselves by providing precise data to show that they benefit 
students in tangible, economic ways. 
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Swanson, A. D. . A Study of the Costs, Benefits, and Effectiveness of Occupational 
Education . Buffalo, NY: State University of New York, 1976. * 

i 

This paper describes the methodology, *f frf3ings , and conclusions of an eight, 
year longitudinal study of the costs, benefits, and effectiveness of occupatiofial\ 
'education offered in a Board of Cooperative Education Services (BOCES) district. 
The objectives of the study were to: ^ 

• Calculate and compare the costs per. pupil for vocational programs offered 
by a regional school, district in the metropolitan area of Buffalo, 

New York, with 'the costs of other programs offered by other regional 
districts of the same fl metropol i tan area. 

• li'.oare zhe- success of graduates of vocanbnal programs, measured 

Zj e' v .o\ ojwenz , earnin::. and selec^rti no*£l^netary considerations, with 
: r e pe^o^mance nor->;ollege boi/d graduates Of academic high schools. 

• Calculate beinef i t-cost. ratios for vocational programs. 

• Develop decision matrices for evaluating the likely cost and effective- 
ness of alternative approaches for meeting district objectives for 
occupational education. 

The study consisted of three phases. First, costs per pupil for the 1972-73 
school year were computed for the 16 occupational programs offered by BOCES. 
Second, economic and noneconomic information on graduates of both BOCES and 
regular high school programs were gathered from school records and through a 
mail/telephone survey. 'Two instruments were used: the School Record Form and ' 
the Alumni Survey Form., Tkvird, comparative costs, cost-benqf i t ratios, and cost- 
effectiveness ratios were computed for both BOCES and- academic high school programs 

Among the study's conclusions were that costs and cost-benefit ratios 
varied by program area within the BOCES district. In particular, the returns 
to v investment in many high cost vocational programs were negative. In addition, 
t^e study fourfd that earnings for, male BOCES students were slightly higher than 
for jion-BOCES students. However, the earnings were not high enough to compen- 
sate for the greater program costs. Fema^a BOCES students earned somewhat less 
than non-BOCES students, However, this difference was attributed to socioeconomic 
and school achievement factory and not to type of training. 
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Taussig, M. K. "An Economic Analysis of Vocational Education in th£ New York 
City Schools." Journal of Human 'Resources 3 (1968): 59-87].' — 



Taussig presents the findings of his cost-benefit study of vocational 
education in New York City based on data througti 1965. He focuses upon the 
employment experience of graduates from city vocational schools. Taussig's 
research is an example of some of the early cdst-benef i t studies that found' 
that vocational training did not. increase theViarket productivity of the 
graduates despite the large incremental costs Jf vocational training. He 
further suggested that the schools' criteria for measuring program success 
are largeVy irrel-eva^t from a.public interest viewpoint. 
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VOCATIONAL EDUCATION 
DATA SOURCES 




Brown, L. Ill, Barnes, R. 
in Vocational Education: 



, Currence, H. and Henderson 
An Assessment. Washington, 



, D. Research Data Resources 
DC: U.S. 



education. 



Department o't 

Office of the Assistant Secretary for Planningand Evaluation, 19§0. 



This paper presents a review of v past and current research and data collection 
.activities in vocational education. Studies reviewed were limited to those 
performed or sponsored between 1972 and 1980 by the Department of Health,- 
Education, and Welfare. The paper discusses 48 studies specifically. These # 
studies were selected on the criteria of being relevant, objective and un- 
biased, reliable, based on systematic information, and capable of generaliza- 
tion. These 48 studies may be divided into si x^oad issue areas: (1) access, 
including sex equity; (2) funding, especially Federal level to state level 
disbursements; (3) planning and management, including state and local -compl iance 
with Federal statutory and regulatory requirements; (4) quality and effective- 
ness, primarily in terms of student economic and educational outcomes; (5) 
education and work, including CETA linkages with schools; and (6) general/ 
miscellaneous studies. 1 

Of particular importance to potential, cost-benefit study teams is a m 
review of data resources which could be utilized in vocational education. 
studiesV The report considered five data resources to be of superior value. 
They arh (1) tjhe High School and Beyond Longitudinal Survey; (2) the National 
Longitudinal Survey - 1979; (3) National Longitudinal Study of the High School Class 
'of 19/2; j(4) Berkeley Survey of Vocational Schools in 10 states; and (5) the 1966 
ffationaT Longitudinal Survey. The report cited deficiencies in the Vocational 
Education Data System (VEDS) data as well as- the BOAE Snnual^ stati stical re- 
ports. The mdjor problems with VEDS are: (1) the lack of a standard definition > 
"of program enrol lees; (2) the absence of information on program duration and 
length of classroom exposure ;*and (3) the lack of comparison standards for 
interpreting reported outcomes. 
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'•own, Ill ana G'i Inartin, J. Report Measures of Participation in 
ccational Education: Enrollments, Students and Exposure . Washington. [}C: 
S. Department of E:ueation / Office of Planning and' Budget, Office of Technical 



ir.c Anal /:i cat ^Svstervs , 1980. 



Tms st^ay, oreo&red to' coincide with Congressional consideration of 
reauthorizing the Vocational Amendments of 1976, critically reviews the official 
enrollment statistics published annually by the Bureau of Occupational and 
Adult Education (BOAE). The reyew is performed by comparing the MAE data 
witn the National Center, for ^catjon Statistics (NCES) data collected in a 
1972 survey of vocational education students in secondary schools. The analysis 
discusses several vocational education accounting concepts *and reporting pro- 
cedures that affect the interpretation of official data for projected enroll- 
ments and future funding. Specifically, the report criticizes the BOAE data 
for overestimating participation in secondary school vocational programs. For 
example, the practice of reporting course enrollments rather than number of 
students can overstate by over one million the number of unduplicated program 
students. 

The implication of the analysis is that the reduced number of vocational 
students will increase the est*#ted cost per student. Costs, per full-time 
equivalent vocational student will be approximately three times higher than per 
student co'sts for non-vocational secondary programs. 

•The report provides an excellent analysis of appropriate measures of 
oarticipation in vocational education programs. The authors propose a measure 
of participation which would account for: (1) duplication arising from a 
student enrolled in more than one vocational class or enrolled in a class that 
is part of two vocational programs; (2^ number of hours of class time; and (3) 
the "lifecycle" of a vocational program. The authors assert that because of 
major differences in patterns of educational exposure for vocational program 
areas, studies of vocational education's effectiveness should concentrate on 
individual programs rather than analyze ^averages computed over a heterogeneous 
set of training programs. 
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Ghazalah, I. A. "Economic Performance of Vocational Education Graduates: A 
Study Based on U.S^Individual Income Tax Data." The Journal of Vocational 
.Education Research (1981):' forthcoming; 

The major objective of the research reported in this article is to devise 
ways to utilize existing data to analyze the impact of ' vocational education on 
tne # performance of its graduates. Most current research uses earnings and other 
related data collected through personal surveys as a measure of vocational bene- 
fits. Ghazalah shows how^data taken from U.S. individual tax returns filed with 
the Internal Revenue Service (IRS) can provide a less costly and more timely 
alternative to survey data. 

The author displays an application of these data by studying 10,731 eleventh 
and twelfth grade vocational graduates who took the Ohio Trade and Industrial 
Education Achievement Test in 1971. He uses the IRS income data as a source of 
information ^on these students' earnings as well as a proxy for their employment 
rates (the number of students ming tax returns) and their interregional 
mobility (the number of students filing tax returns in 1974 by region versus 
the tiumber of vocational students in 1971 by region). 
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a'KUWul fst>erg, R. M. 
dashinaton, DC: ♦National 



he Condition of Vocational Education : 

Center fo^ Education Statistics, 1980 



>is report was orepared to- supplement testimony to the Subcommittee* on 
-le-entatv. Secondare, 'and Vocational Education, Committee on Education -and 
Zaoor, J.S. house'Qf "*Representati ves . The report characterizes vocational _ 
education's providers, offerings, students, facilities, instructional staff, 
and finances . * 

The "report also presents statistical' tables regarding "the condition of 
vocational education. Many of the tables were previously unpublished. _ These 
include tables related to. institutional providers of vocational education, 
enrollments, profiles of students, staff, facilities, allocations and ex- . 
penditures, costs-facing vocational students, and outcomes of vocational 
education. 



Grasso, J. T. and Shea, J. R. "Effects of Vocational- Education Programs: 
Research Findings and Issues. 1 ' The Planning Papers for the Vocational Educa- 
tion Study . Washington, DC: National Institute of Education, 1979. 

Jhis is an overview of existing data bases,, vocational education evalua- 
tions, and *cost-benefi t study findings 'Grasso and Shea* begin by synthesizing 
the data and research based on the* results of four national longitudinal surveys 
Project Talent, Youth 'in Transition, /the National Longitudinal Surveys, and 
the National Longitudinal Study of the High School Class of 1972. < 



jhey'then summarize various vocational evaluation and cost-benefit study 
figdings for the data bases by subject area. "Findings are reported on voca- 
tional students'^ socioec$0£mic status aVid innate ability, educational aspirations,, 
attitudes towards school, occupational goals, career choices, post-school training, 
economic success, and psychological cap^biljty. 
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Hopkins, C. '0. Data Sources for Vocational Education Evaluation / Columbus, 
OH: Ohio State University* National Center for Research 'in Vocational Education, 
\. • 1979. 

* This paper summarizes the' informational needs, potential data sources, $nd 
data deficiencies for evaluation of. vocational education programs. The primary 
~V sources for evaluation data are: Bureau of Labor.Statistics,iBureau of Census, 
state employment security' agencies, National Center for Education Statistics 
and state management information systems. The paper includes. -two informative 
appendices. The first describes major sources of data by broad data element 
. .needs. The second gives more detailed information. concerning availability* 
of specific information needs. 




* 



Kay, E. R. (ed.). Enrollments and Programs in Noncol legiate Post'secondary 
Schools, 1978 . Washington, DC: National Center for Education Statistics, . 

1979. 



This resource is a compilation of statistics, figures, and tables on the 
number of students preparing for technical careers in noncollegiate post- 
secondary schools. The text is divided* into separate findings for corre- 4 « 
spondence schools and noncorrespondence schools. The data were collected J 
from a sample of schools in conjunction with the development. of the Dj rectory 
of Postsecondary Schools with Occupational Programs . 




Lee, A. M. . Use of Evaluatiye Data by Vocational Educators, . .Columbus, OH: 
Ohio State Uni versi ty , * NaMonal Center fof Research in Vocational Education, 

1979. ^ S 



In this paper, Lee notes that considerable research exists on approaches to 
and procedures for eval uation'research in vocational education. However, very 
little has been written on the use of the research by vocational educators. 
This paper is intended to provide some scholarship in this area. - 

He* first describes conditions that govern the use of vocational - cteta . 
These include availability, reliability, credibility, and uti]ity. ' Lee then 

jsses-C^tential and actual uses of evaluative dataM^y vocational educators 
and the effecTn/H n e ss in - frte-trSe of these data. He concludes by making five 
recoTnmeridations for the further use of evaluative data. 




Lee, A. M. "The Vocational 'Education Data Base." The Planning Papers for the ' 
Vocational Education Study . Washington, DC: National Institute of Education, 
1979. • 



'ailabil.it;' and quality of vocational educaipr 
federal levels. Lee suaqests that the primR?s 



,ms paper surveys the avai._,, .^ ... 
aata on the local, state, and federal level_s. Lee suggests that the primwy 
failing of existing data is incompat^J/^ty. This incompatibility fs the 4 * 
result of sucn factors as lack of quality control at the federal level, urt-" - 
standardized cfesfin-Kions of course enrollment and curricul urn,- variations in 
the automated reporting capacities of states*and local-ities, and the time 
delay betweeq^^e school year and data availability. 

Lee writes that two major elements in improving data consistency,' and 
thereby data ^ualrty, can be federal reporting requirements and the, further 
development of automated information systems. However, there are a^number of 
obstacles to the potential impact of federal reporting^: 5 

• Many states are unwilling toilet the federal government dictate 
data elements and data format. 



V 



Various political ramifications may undermine the intentions o- 
reporting systems. 

Inadequate fundjng and staff prevent- mai ntenance of report 1 *^ g 
quality. 
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Pucell, 0. J. Longitudinal Methods as Tools for Evaluating Vocational Education . 
Columbus, OH: Ohio State University, National Center for Research i^n Vocational 
Education, 1 979 4 . ' \ % 

» 

This paper presents the advantages and disadvantages of using lorigi tudi/ial 
methods of evaluating vocational education. The' 1 i terature review for this 
, paper indicates that longitudinal methodologies have not been often utilized 
s ' by vocational educators. 'The author suggests that this method would be npst 
useful in answering questions such as: 

• Does vocational education make a difference? t 

• • ^ i What program practices increase the possible success of vocational 
graduates? . 

• What are the additional costs of preparing special needs students 
(jor employment? 

" Lcngi tuairval data bases generated on a continual basis would allow educator^ 
to ask questions and examine relationships which would more ^readily provide 
information on the impact of program changes upon students. 




4 



Woods, E.-M. "National 'Longi tudrna 1 Studies and Dat/'Sfets." 
(September 1980): 35-38, 53. 
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In this article, Woods has identified several common methodological concerns 
regarding the use of longitudinal data. Five national longitudinal data sets 
are specifically reviewed regarding their relevancy to an evaluation of voca- 
tional education. These data sets are: Project Talent; Youth in 'Transition; 
National Longitudinal Surveys; National Longitudinal Study of the High School 
Class of 1972; and National Longitudinal Survey (new cohort). y 

Several 1 imitations^ v/ere noticed in a cross comparison of the selected 
data sets. Since e^ch dara^set was collected with differen-t objectives in m>nd,' 
the sample size and'type varies. Also, vocational "programs have changed * 
between tne oldest study (1960) and the newest study (1979). 



Woods aFso discusses potential sources of discrepancies in defining a 
vocational* student and course of study. First, students and administrators 
tay have /arying, perceptions of the kind of»program in which the student 
oarticiaatec. Program classifications differ according to the researcher's 



to 

quality 
/ 



grou**) all vocational programs in the same 
, cbntent v duration, and. intensity is also 



apDroacn as*w§ll. The tendency 
category vfithout regard .to 
a problem. 

f « , 

In reviewing program outputs, Woods empahsizes the need to control for' 
differences in student background and othe^. variables. The problems in over- 
aggregation are also noted. Becasue of the dificiencies in the available data, 
/ioods asserts that "we should probably not even try to estimate effects, but 
instead, in accordance with the limitations of the available data, merely 
estimate outcomes associated with different kinds of vocational education." 
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SECTION 5 
, GLOSSARY 

' » 1 

Adult Education - Basic instruction for adults that nay be provided by a school 
system, college, or other , institution but is, usually apart from the regular,, 
matriculating program, 

Area Vocational School - A public school approved by a State Board of Vocational 
Education to provide occupation training to residents Of the state, county, 
city, or other geographi c 'area usually larger than the local basic admini- j 
strative unit. - ' 

Ayerage^Cost - THe toal cost of a program divided by the number of units 
produced or consumed. 

Average Baily Attendance (ADA) - The sum of each day's attendance Suring the 
school year divided "by the total number of school 'days. 

Average Daily Membership (ADM) - The Sum of ea£fc day's enrollment during the 
school year divided by the total number of school days. 

Benef i t - A consequence or outcome of the educational process measured in monetary 
v or non-pecuniary terms. 



Capital Costs - Costs incurred for the purchase of capital equipment (e.g. " 
machinery, buildings, etc.) ' 

Career" Education - Planned education experiences by i^jjich one prepares for a career. 

Comprehensive Hjflh School - A secondary school offering diversified curricula such 
as academic, industrial, business, and/or vocational 1 * programs. 

Consumption !- The use of resources purely for immediate personal gratification^ 
and not for future income gains. * 

Cooperative Education - A combined program of school instruction and on-the-job 
.training. ^ 

Cost - A monetary or hon-pecuniary unit th£t is incurred in obtaining , an outcome or 
* consequence. . - 4 

'Cost-Benefit Analysis - An analytic framework in which the cost 3nd benefits <Jf 
a project*are compared^ 

Cost-Benefit Ratio - An analytic tool used in cost-benefit analysis whiek relates 
costs and benefits by-dividing total benefits by total costs. 
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Cost-Ef f ecti vgness Analysis - An analytic framework which relates program costs 
! to a Quantified level of effectiveness. 

Direct Costs and -Benefits - Costs and b^rfefits resulting directly from participator 
in or conducting of a program. 

Discount Rate -'A factor which "discounts" future earnings and costs to a 
present value. 

Disposable Income - Total income after t,axes. 

Dual Enrollment - An arrangement where a student concurrently attends two schools 
part-time suCh*as a secondary school and ah area .vocational school. This is 
al so call fid shared time. 

. r 

- k 

Earnings - Money earned through labor rather than investments. 

Earnings Multiplier Effect - The interactive chain of increased earnings that 
results from one individual receivinq an increase in disposable income and 
spending part of that increase which, in turn, increases the income of another 
individual , etc. . **• 

Educational Inputs - Inputs uSed in the process of providing an education (e.g. 
teachers, books, buildings, etc.). ** 

Educational Outputs - Outputs resulting from the educational process (e.g. 
knowledgeable students). 

^ y 

External ity. - The result tf£ an economic action that affects individuals (positively 
or negatively) Jiot directly involved in the transaction. 

Forgone Igcome - The potential income that is given up by an *indi vidual wftile 
attendi ng school .* 

t> 

Ful 1 -Time Equi^lent (FTE) - A measure of the equivalent number of full-time 

students in 3 school. It is calculated by determining the number of classroom 
hours for a full-time Student and summing the proportions of this -figure for 
all students. ^ 

Holding Power - A measure of^student retention represented by the percentage of 
students who remain in a program. Therefore, this is the inverse of tfife , 
\j dropout rate. 

Income* - Money earned through- >£bor, investments, etc. , 

Indirect Costs and Benefits '- -Costs ^nd benefits that are an indirect result of 
participating in. a program. ^ ^ 

Investment - The use of resources to increase future -levels of income or consumption 
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Joint Costs - Costs associated with an educational input that are used by more 

than one student cohort group.' ^ * » • 

Longitudinal Data - Information collected on students or individuals over time. 

Management Information System (MIS) - A reservoir of data that usua.lly is accessed * 
by computer. The system may be used to make efficient expenditure decisions or* 
to compare the effectiveness of alternative, policies. 

Ma npower Training - Job oriented or vocational training normally provided outside 
of formal school settings. 

Marginal Costs - The addition to total cost of a unit' increase in output. 

Net Present Value - An analytic tool used 'in cost-benef i t analysi s that repre- 
V sents the difference between the present value' of the benefit? and cost streams. 
/ " * , ' 

' ^-Pecunia ry Costs and Benefits - Costs and benefits generally not quantifiable 
in monetary terms. _ . ;> i 

v 

Opportunity Costs' - The value of using an. actiyi ty 1 s (inputs for -an alternative 
^ Purpose. 



Postsecondary Education - Instructional programs prov^ed for students who have 
completed elementary 'and secondary school programs. „ 

- Private Benefits and Costs - Benefits and costs accruing to the student receivnnq 
educational training. ■ 

Production Function - An analytical tool that-relates quantities of inputs, to one 
or more outputs. 

Productivity - The measure of output per unit of input. ' 

# 

Proprietary School - A private or non-public school which operates as a Business 
for profit. \ 

X " * 

Public Good - An item which everyone may enjoy and not be excluded fromX^S 

benefits. An often-(used example is national defense. \ I 

Rate of Return . > A percentage calculation indicating the economic return on ' ■ 
iriyestment. 

Regression Analysts - A statistical technique which relates a dependent variable 
to a group of independent variables. 

Shadow Price - The price attributed to a "good 'or service by an evaluator when, 

from the viewpoint of the eval uator , ;the good or service is not appropriately 
priced, 'due to externalities or other market inadequacies. This is also known 
. as accounting price. — 

L ^ x » 
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, Social Benefits and Costs - Benefits and costs accruing to society as a %sult 
of a student receiving educational training; m 

Stuaent-uni fr - A unit of measure generally used d as the primary measure of ^ 
student participation. * * t% ' 

Tgchm.cal Insti tute „- An institution offering instruction primarily in. one or - 
more tectfnica\ fields at the postsecondaYy level. 

??»c'ationa1 Education , - Education in o?TH or more semi-skilled, skilled, *or technical 
ocpupa tions . ' * > ' * * 

Vocational Rehabilitation - The.-service of preparing disabled persons for 'employ- 
ment through diagnosis, guidance, training, and' pi acement. / 
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